Projector Device, Portable Telephone and Camera

ABSTRACT

A projector device that generates a projection image, photographs this projection image and performs various adjustments to the projection image.

TECHNICAL FIELD

The present invention relates to a projector device which projects animage upon a projection surface and generates this projection image,such as a projection type liquid crystal projector which uses a liquidcrystal display panel, and which is a handy type of projector device orthe like housed in a portable telephone or a camera.

BACKGROUND ART

As a projection type liquid crystal projector, one which uses a halogenlamp or a xenon lamp or the like as a light source is known from thepast. Such a projector separates the light outputted from the lightsource into red (R), green (G), and blue (B) primary colored lights,synthesizes them together again after having passed each of them througha different liquid crystal display panel, and projects the synthesizedlight via a projection lens upon a projection surface such as a screenor the like. However, with this kind of projection type liquid crystalprojector which uses a lamp light source, there has been the shortcomingthat the device has been large in size, since it is necessary to performseparation and synthesis in the optical system. Thus, in order toresolve this shortcoming, it is known to use as the light source, forexample, R, G, and B laser light (Patent Document 1), or R, G, and B LEDlight (Patent Document 2) or the like.

Patent Document 1: Japanese Laid-Open Patent Publication No. H9-326981

Patent Document 2: Japanese Laid-Open Patent Publication No. 2000-194275

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention

By making the device more compact by using a light source such as thosedisclosed in Patent Documents 1 and 2, it is possible to build aprojection type liquid crystal projector of a handy type which can beused while being hand-held. However, since a handy type projection typeliquid crystal projector is used by being held in the hand of the user,accordingly, as compared to projection type liquid crystal projectors ofthe prior art stand-mounted type, there are various different aspects toconsider with regard to the method of use. Due to this, various kinds ofoperations have been necessary in order to implement a handy typeprojection type liquid crystal projector which can easily be employedfrom the point of view of the user, which have not been needed in thecase of a prior art stand-mounted type projection type liquid crystalprojector.

Means for Solving the Problems

The projector device according to the present invention generates aprojection image, photographs this projection image and performs variousadjustments to the projection image.

The projector device according to the present invention comprises aprojection image generation device that projects an image upon aprojection surface and generates a projection image of the image, aphotographic device that photographs an object to be photographed andacquires a photographic image of the object, and a calibration controldevice that repeatedly executes calibration operation for adjusting anappearance of the projection image on the projection surface duringprojection of the projection image, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device.

In the projector device described above, the calibration control devicecan repeatedly execute the calibration operation upon a fixed cycle. Or,the projector device can further comprise an actuation input device forreceiving actuation input from a user, and the calibration controldevice can repeatedly execute the calibration operation each timeactuation input is performed to the actuation input device.

In the projector device according to the present invention, theprojection image generation device can project an image which includes apredetermined shape pattern, and the calibration control device canexecute the calibration operation based upon the predetermined shapepattern which is included in a photographic image of the projectionimage.

In the projector device described above, it is desirable that theprojection image generation device projects the image including thepredetermined shape pattern for a predetermined short time period, andthat the photographic device photographs the projection image as anobject to be photographed in synchronization with projection timing ofthe image.

In the projector device described above, the projector device mayfurther comprise a setting device that sets a frequency for execution ofthe calibration operation, and when a first execution frequency is setby the setting device, the calibration control device may repeatedlyexecute the calibration operation during the projection of theprojection image, when a second execution frequency is set, thecalibration control device may execute the calibration operation onlyonce during projection of the projection image, and when a thirdexecution frequency is set, the calibration control device may notexecute the calibration operation.

Or, the projector device according to the present invention comprises aprojection image generation device that projects an image including apredetermined shape pattern upon a projection surface and generates aprojection image of the image, a photographic device that photographs anobject to be photographed and acquires a photographic image of theobject, and a focusing device that adjusts a focus state of theprojection image based upon the predetermined shape pattern included inthe photographic image of the projection image which is acquired byphotography by the photographic device.

Alternatively, the projector device according to the present inventioncomprises a projection image generation device that projects either oneof a still image and a moving image upon a projection surface andgenerates a projection image of the still image or the moving image, aphotographic device that photographs an object to be photographed andacquires a photographic image of the object, and a focusing device that,when the still image is projected by the projection image generationdevice, adjusts a focus state of the projection image based upon thephotographic image of the projection image which is acquired byphotography by the photographic device.

In the projector device described above, when projecting the movingimage, the projection image generation device can include apredetermined shape pattern in the moving image during projection, andwhen the moving image in which the predetermined shape pattern isincluded is projected by the projection image generation device, thefocusing device can adjust the focus state of the projection image basedupon the predetermined shape pattern which is included in thephotographic image of the projection image.

In the projector device described above, the focusing device mayrepeatedly perform the adjustment of the focus state of the projectionimage during the projection of the projection image. At this time, it isdesirable that the adjustment of the focus state of the projection imageis repeatedly performed upon a fixed cycle. Or, the projector device mayfurther comprise an actuation input device for receiving actuation inputfrom a user, and the focusing device may repeatedly perform theadjustment of the focus state of the projection image each timeactuation input is performed to the actuation device.

In the projector device described above, it is preferable that theprojection image generation device projects the image including thepredetermined shape pattern for a predetermined short time period, andthat the photographic device photographs the projection image as theobject to be photographed in synchronization with projection timing ofthe image.

In the projector device described above, the projector device mayfurther comprise a setting device that sets a frequency of adjustment ofthe focus state of the projection image, and when a first frequency ofadjustment is set by the setting device, the focusing device may performadjustment of the focus state of the projection image repeatedly duringthe projection of the projection image, when a second frequency ofadjustment is set, the focusing device may perform adjustment of thefocus state of the projection image only once during the projection ofthe projection image, and when a third frequency of adjustment is set,the focusing device may not perform adjustment of the focus state of theprojection image.

Or, the projector device according to the present invention comprises aprojection image generation device that projects an image including apredetermined shape pattern upon a projection surface and generates aprojection image of the image, a photographic device that photographs anobject to be photographed and acquires a photographic image of theobject, and a brightness adjustment device that adjusts a brightness ofthe projection image based upon the predetermined shape pattern includedin the photographic image of the projection image which is acquired byphotography by the photographic device.

Alternatively, the projector device according to the present inventioncomprises a projection image generation device that comprises a lightsource, projects an image by using light emitted from the light sourceupon a projection surface and generates a projection image of the image,a photographic device that photographs an object to be photographed andacquires a photographic image of the object, and a brightness adjustmentdevice that adjusts a brightness of the projection image based upon thephotographic image of the projection image which is acquired byphotography by the photographic device, by varying amount of lightemission from the light source.

In the projector device described above, if the brightness of theprojection image is darker than a predetermined reference value, thebrightness adjustment device can adjust the brightness of the projectionimage by decreasing the amount of light emission from the light source,and if the brightness of the projection image is brighter than thereference value, the brightness adjustment device can adjust thebrightness of the projection image by changing brightness of the imagebeing projected.

In the projector device described above, the brightness adjustmentdevice can repeatedly perform the adjustment of the brightness of theprojection image during the projection of the projection image. At thistime, it is desirable that the adjustment of the brightness of theprojection image is repeatedly performed upon a fixed cycle. Or, theprojector device may further comprise an actuation input device forreceiving actuation input from a user, and the brightness adjustmentdevice may repeatedly perform the adjustment of the brightness of theprojection image each time actuation input is performed to the actuationdevice.

In the projector device described above, it is preferable that theprojection image generation device projects the image including thepredetermined shape pattern for a predetermined short time period, andthat the photographic device photographs the projection image as theobject to be photographed in synchronization with projection timing ofthe image.

In the projector device described above, the projector device mayfurther comprise a setting device that sets a frequency of adjustment ofthe brightness of the projection image, and when a first frequency ofadjustment is set by the setting device, the brightness adjustmentdevice may perform adjustment of the brightness of the projection imagerepeatedly during the projection of the projection image, when a secondfrequency of adjustment is set, the brightness adjustment device mayperform adjustment of the brightness of the projection image only onceduring the projection of the projection image, and when a thirdfrequency of adjustment is set, the brightness adjustment device may notperform adjustment of the brightness of the projection image.

Or, the projector device according to the present invention comprises aprojection image generation device that projects an image including apredetermined shape pattern upon a projection surface and generates aprojection image of the image, a photographic device that photographs anobject to be photographed and acquires a photographic image of theobject, and a hue adjustment device that adjusts the hue of theprojection image based upon the predetermined shape pattern included inthe photographic image of the projection image which is acquired byphotography by the photographic device.

Alternatively, the projector device according to the present inventioncomprises a projection image generation device that comprises a lightsource which emits light of a plurality of colors, projects an image byusing light synthesized from the light of various colors emitted fromthe light source upon a projection surface and generates a projectionimage of the image, a photographic device that photographs an object tobe photographed and acquires a photographic image of the object, and ahue adjustment device that adjusts a hue of the projection image basedupon the photographic image of the projection image which is acquired byphotography by the photographic device, by varying amount of lightemission from the light source for each of its light emitting colors.

In the projector device described above, the hue adjustment device canrepeatedly perform the adjustment of the hue of the projection imageduring the projection of the projection image. At this time, it isdesirable that the adjustment of the hue of the projection image isrepeatedly performed upon a fixed cycle. Or, the projector device mayfurther comprise an actuation input device for receiving actuation inputfrom a user, and the hue adjustment device may repeatedly perform theadjustment of the hue of the projection image each time actuation inputis performed to the actuation device.

In the projector device described above, it is desirable that theprojection image generation device projects the image including thepredetermined shape pattern for a predetermined short time period, andthat the photographic device photographs the projection image as theobject to be photographed in synchronization with projection timing ofthe image.

In the projector device described above, the projector device mayfurther comprise a setting device that sets a frequency of adjustmentfor the hue of the projection image, and when a first frequency ofadjustment is set by the setting device, the hue adjustment device mayperform adjustment of the hue of the projection image repeatedly duringthe projection of the projection image, when a second frequency ofadjustment is set, the hue adjustment device may perform adjustment ofthe hue of the projection image only once during the projection of theprojection image, and when a third frequency of adjustment is set, thehue adjustment device may not perform adjustment of the hue of theprojection image.

Or, the projector device according to the present invention comprises aprojection image generation device that projects an image including apredetermined drawing or symbol for specifying a shape of a projectionimage upon a projection surface and generates a projection image of theimage, a photographic device that photographs an object to bephotographed and acquires a photographic image of the object, and atrapezoidal compensation device that compensates trapezoidal deformationof the projection image created according to an angle between aprojection direction of the projection image generation device and theprojection surface, based upon the drawing or symbol included within thephotographic image of the projection image which is acquired byphotography by the photographic device.

Alternatively, the projector device according to the present inventioncomprises a body portion that has a construction to be folded around ahinge unit as a center and comprises a first portion and a secondportion which are linked by the hinge unit, a detection device thatdetects a folding angle of the body portion, a projection imagegeneration device that projects an image upon a projection surface andgenerates a projection image of the image, whose projection direction isfixed with respect to the first portion, and a trapezoidal compensationdevice that compensates trapezoidal deformation of the projection imagecreated according to an angle between the projection direction of theprojection image generation device and the projection surface, basedupon the folding angle which is detected by the detection device.

Otherwise, the projector device comprises a body portion that comprisesa first portion which has a construction to be rotated around apredetermined rotation shaft as a center and a second portion which islinked to the first portion, a detection device that detects arotational angle of the first portion with respect to a predeterminedreference position, a projection image generation device that projectsan image upon a projection surface and generates a projection image ofthe image, whose projection direction is fixed with respect to the firstportion, and a trapezoidal compensation device that compensatestrapezoidal deformation of the projection image created according to anangle between the projection direction of the projection imagegeneration device and the projection surface, based upon the rotationalangle which is detected by the detection device.

In the projector device described above, the trapezoidal compensationdevice can repeatedly perform the compensation of the trapezoidaldeformation during the projection of the projection image. At this time,it is desirable that the compensation of the trapezoidal deformation isrepeatedly performed upon a fixed cycle. Or, the projector device mayfurther comprise an actuation input device for receiving actuation inputfrom a user, and the trapezoidal compensation device may repeatedlyperform the compensation of the trapezoidal deformation each timeactuation input is performed to the actuation device.

In the projector device described above, it is desirable that theprojection image generation device projects the image including thedrawing or symbol for a predetermined short time period, and that thephotographic device photographs the projection image as the object to bephotographed in synchronization with projection timing of the image.

In the projector device described above, the projector device mayfurther comprise a setting device that sets a frequency of compensationof the trapezoidal deformation, and when a first frequency of adjustmentis set by the setting device, the trapezoidal compensation device mayperform compensation of the trapezoidal deformation repeatedly duringthe projection of the projection image, when a second frequency ofadjustment is set, the trapezoidal compensation device may performcompensation of the trapezoidal deformation only once during theprojection of the projection image, and when a third frequency ofadjustment is set, the trapezoidal compensation device may not performcompensation of the trapezoidal deformation.

Or, the projector device according to the present invention comprises aprojection image generation device whose projection focal point positionis variable, that projects an image upon a projection surface andgenerates a projection image of the image, a photographic device whosephotographic focal point position is variable, that photographs anobject to be photographed and acquires a photographic image of theobject, and a calibration control device that executes a calibrationoperation for adjusting an appearance of the projection image upon theprojection surface, based upon the photographic image of the projectionimage which is acquired by photography by the photographic device. And,the projection image generation device generates the projection imagesfor a plurality of different projection focal point positions, thephotographic device acquires the photographic images of the plurality ofprojection images which is generated by the projection image generationdevice at the plurality of projection focal point positions,respectively at a plurality of photographic focal point positions atwhich the distances with respect to the projector device arerespectively almost equal to those at the plurality of projection focalpoint positions, and the calibration control device executes thecalibration operation based upon the photographic images of theplurality of projection images which is acquired by the photographicdevice at the plurality of photographic focal point positions.

Alternatively, the projector device according to the present inventioncomprises a projection image generation device whose projection focalpoint position is variable, that projects an image upon a projectionsurface and generates a projection image of the image, a photographicdevice whose photographic focal point position is variable, thatphotographs an object to be photographed and acquires a photographicimage of the object, and a calibration control device that executes acalibration operation for adjusting an appearance of the projectionimage upon the projection surface, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device. And, the projection image generation devicegenerates the projection images for a plurality of different projectionfocal point positions, the photographic device acquires the photographicimages of the plurality of projection images which is generated by theprojection image generation device at the plurality of projection focalpoint positions, all at a single fixed photographic focal pointposition, and the calibration control device executes the calibrationoperation based upon the photographic images of the plurality ofprojection images which is acquired by the photographic device at thesingle photographic focal point position.

In the projector device described above, if the photographic images ofthe plurality of projection images which is acquired by the photographicdevice at the single photographic focal point position satisfy apredetermined condition, it is preferable that, after adjusting thephotographic focal point position based upon the photographic images ofthe plurality of projection images, the generation of the plurality ofprojection images by the projection image generation device and theacquisition of the photographic images of the plurality of projectionimages by the photographic device are performed for a second time, withthe photographic focal point position after adjustment. Or, in theprojector device described above, the photographic device may acquireeach of the photographic images of the plurality of projection images byfixing the photographic focal point position, so as to obtain a panfocus state in which the focus of the photographic images which areacquired is set from close to infinity.

In the projector device described above, the projector device mayfurther comprise a state storage device that stores a state of thephotographic focal point position before the projection image isphotographed by the photographic device, and, after the generation ofthe projection image by the projection image generation device isstopped, or after the execution of the calibration operation by thecalibration control device is stopped, the photographic focal pointposition may be returned to its state stored by the state storagedevice.

Or, the projector device according to the present invention comprises aprojection image generation device that projects an image upon aprojection surface and generates a projection image of the image, aphotographic device that is capable of zooming, photographs an object tobe photographed and acquires a photographic image of the object, azooming control device that controls a zoom position of the photographicdevice, and a calibration control device that executes a calibrationoperation for adjusting an appearance of the projection image upon theprojection surface, based upon the photographic image of the projectionimage which is acquired by photography by the photographic device. And,when photographing the projection image by the photographic device, thezooming control device controls the zoom position of the photographicdevice to a predetermined zoom position which is set in advance, so thata photographic range of the photographic device includes at least aprojection range of the projection image.

In the projector device described above, it is desirable that theprojector device further comprises a state storage device that stores astate of the zoom position before the projection image is photographedby the photographic device, and, after the generation of the projectionimage by the projection image generation device is stopped, or after theexecution of the calibration operation by the calibration control deviceis stopped, it is desirable that the zoom position is returned to itsstate stored by the state storage device.

Or, the projector device according to the present invention comprises aprojection image generation device that comprises a light source whichemits light of a predetermined hue characteristic, projects an image byusing light emitted from the light source upon a projection surface andgenerates a projection image of the image, a photographic device thatphotographs an object to be photographed and acquires a photographicimage of the object, a hue adjustment device that adjusts a hue of thephotographic image, and a calibration control device that executes acalibration operation for adjusting an appearance of the projectionimage upon the projection surface, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device. And, when photographing the projection image by thephotographic device, the hue adjustment device adjusts the hue of theacquired photographic image based upon predetermined color conversionrules set in advance according to the hue characteristics of the lightsource.

In the projector device described above, it is desirable that theprojector device further comprises a state storage device that stores astate of color conversion rules by the hue adjustment device before theprojection image is photographed by the photographic device, and, whenthe projection image is not being photographed by the photographicdevice, it is desirable that the hue of the photographic image isadjusted by the hue adjustment device, based upon color conversion ruleswhich are different from the predetermined color conversion rules, andafter the generation of the projection image by the projection imagegeneration device is stopped, or after the execution of the calibrationoperation by the calibration control device is stopped, it is desirablethat the state of the color conversion rules for the hue adjustmentdevice is returned to its state stored by the state storage device.

Or, the projector device according to the present invention comprises aprojection image generation device that projects an image upon aprojection surface and generates a projection image of the image, aphotographic device that photographs an object to be photographed andacquires a photographic image of the object, a photographic directionchange mechanism that changes a photographic direction of thephotographic device, a calibration control device that executes acalibration operation for adjusting an appearances of the projectionimage upon the projection surface, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device, a decision device that decides whether or not aprojection direction of the projection image generation device and thephotographic direction of the photographic device are the samedirection, and a warning device that emits a warning when it is decidedby the decision device that the projection direction and thephotographic direction are not the same direction.

Alternatively, the projector device according to the present inventioncomprises a projection image generation device that projects an imageupon a projection surface and generates a projection image of the image,a photographic device that photographs an object to be photographed andacquires a photographic image of the object, a photographic directionchange mechanism that changes a photographic direction of thephotographic device, a calibration control device that executes acalibration operation for adjusting an appearance of the projectionimage upon the projection surface, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device, a decision device that decides whether or not theprojection direction of the projection image generation device and thephotographic direction of the photographic device are the samedirection, and an operation permission device that permits an operationof the projection image generation device only if it is decided by thedecision device that the projection direction and the photographicdirection are the same direction.

The portable telephone according to the present invention comprises theprojector device any one of which described above and a wirelesscommunication device that performs communication with another terminalvia an external wireless communication facility. And the cameraaccording to the present invention comprises the projector device anyone of which described above.

It should be noted that each of the devices described above can bereplaced by a means for achieving same function. Namely, the projectionimage generation device may be replaced by a projection image generationmeans. Moreover, a photographic means may be used instead of thephotographic device. Similarly, the calibration control device may bereplaced by a calibration control means and the actuation input devicemay be replaced by an actuation input means. A setting means can be usedin place of the setting device.

In the same manner as described above, the focusing device may bereplaced by a focusing means. The brightness adjustment device may bereplaced by a brightness adjustment means. The hue adjustment device maybe replaced by a hue adjustment means. The trapezoidal compensationdevice may be replaced by a trapezoidal compensation means. Thedetection device may be replaced by a detection means. The zoomingcontrol device may be replaced by a zooming control means. The statestorage device may be replaced by a state storage means. The decisiondevice may be replaced by a decision means. The warning device may bereplaced by a warning means. The operation permission device may bereplaced by an operation permission means. The wireless communicationdevice may be replaced by a wireless communication means.

EFFECT OF THE INVENTION

According to the present invention, it is possible to implement a handytype projection type liquid crystal projector which can easily be used,by performing various types of operation which have not been needed inthe case of a prior art stand-mounted type projection type liquidcrystal projector.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a figure showing the external appearance of a portabletelephone device with incorporated projector according to an embodimentof the present invention;

FIG. 2 is a block diagram of this portable telephone device withincorporated projector;

FIG. 3 is a sectional view of a projector module;

FIG. 4 is a figure showing a situation in which an image for contrastcalculation has been superimposed upon an image which is a subject forprojection;

FIG. 5 is a timing chart showing the timing of superimposing this imagefor contrast calculation;

FIG. 6 is a figure showing a situation in which an image for brightnessdetection has been superimposed upon an image which is a subject forprojection;

FIG. 7 is a figure showing a situation in which a drawing for shapespecification has been superimposed upon an image which is a subject forprojection;

FIG. 8 is a figure showing a relationship between folding angle θ andtrapezoidal deformation;

FIG. 9 is a figure showing a relationship between rotational angle φ andtrapezoidal deformation;

FIG. 10 is a figure showing a situation in which adjustment of the focusof a photographic image and adjustment of the focus state of aprojection image are performed simultaneously using the same focal pointshifting method;

FIG. 11 is a figure showing a situation in which adjustment of the focusof a photographic image and adjustment of the focus state of aprojection image are performed separately using a camera fixed method;

FIG. 12 is a figure showing a situation when controlling zoom positionso that the photographic range includes the projection range; and

FIG. 13 is a figure showing the external appearance of a portabletelephone device with incorporated projector according to anotherembodiment of the present invention.

DESCRIPTION OF THE SYMBOLS

-   1: actuation section-   2: display section-   3: folding hinge unit-   4: main liquid crystal display device-   5: sub-liquid crystal display device-   6: projector module-   7: camera module-   10: portable telephone device with incorporated projector-   61: projection lens-   62: liquid crystal panel-   63: LED light source-   64: LED drive unit-   65: liquid crystal drive unit-   66: lens drive unit-   71: photographic lens-   72: image sensor-   73: lens drive unit-   74: camera control CPU-   101: CPU-   102: memory-   103: short distance communication unit-   104: memory card-   105: mike-   106: external interface-   107: power supply-   108: communication control unit-   109: antenna-   110: actuation key group-   111: speaker-   112: opening and closing angle sensor

BEST MODE FOR CARRYING OUT THE INVENTION First Embodiment

In the following, a first embodiment for implementation of the presentinvention will be explained with reference to the drawings. FIG. 1 is afigure showing the external appearance of a portable handy type portabletelephone device with incorporated projector 10 according to anembodiment of the present invention according to this first embodiment.(a) shows an elevation view, (b) shows a side view, and (c) shows a rearview. In FIG. 1, the body of this portable telephone device withincorporated projector 10 consists of an actuation section 1 and adisplay section 2, and the actuation section 1 and the display section 2are linked together via a folding hinge unit 3 which can be rotated. Inother words, this portable telephone device with incorporated projector10 has a folding construction, and can be folded about the folding hingeunit 3 as a rotational center.

Various types of actuation key for receiving actuation input from theuser are provided to the actuation section 1. Among these actuationkeys, there are included certain keys which are the same as on aconventional portable telephone, and which are endowed with a camerafunction, an email transmission and reception function, a function ofconnection to the Internet, and the like. For example, there areincluded actuation keys for starting or ending a telephone conversation,actuation keys for inputting a telephone number or characters or thelike, cursor keys for screen actuation, actuation keys for transitioningto various types of operational mode such as a camera photography mode,an email transmission and reception mode, an internet connection mode,and the like. In addition to the same actuation keys as are providedupon a conventional portable telephone device, the actuation section 1is also provided with an actuation key for transitioning to a mode forprojecting an image using a projector module 6 which will be describedhereinafter (i.e. a projector mode). For example, when an actuation keydenoted by the reference symbol 21 is pressed, the system transitions tothe projector mode, in which an image created as will be describedhereinafter is projected by the projector module 6 upon a projectionsurface such as a screen or a wall surface or the like, so that aprojection image of this image is created.

A main liquid crystal display device 4 is disposed upon the front sideof the display section 2, and a sub-liquid crystal display device 5 isdisposed upon its rear surface side. A projector module 6 and a cameramodule 7 are also disposed upon the rear surface side of the displaysection 2.

FIG. 2 is a block diagram of this portable telephone device withincorporated projector 10 of FIG. 1. In FIG. 2 there are provided, onthe side of the actuation section 1, a CPU 101, a memory 102, a shortdistance communication unit 103, a mike 105, an external interface (I/F)106, a power supply 107, a communication control unit 108, an antenna109, an actuation key group 110, a speaker 111, and an opening andclosing angle sensor 112; and a removable memory card 104 is alsoimplemented.

On the side of the display section 2, there are provided the main liquidcrystal display device 4, the sub liquid crystal device 5, the projectormodule (projector unit) 6, a camera module (camera unit) 7, and aspeaker 201.

Based upon a control program, the CPU 101 performs predeterminedcalculation and the like using signals inputted from various unitsincorporated in this portable telephone device with incorporatedprojector 10, and controls each of telephone device operation, cameraoperation, and projector operation by sending control signals to variousunits of this portable telephone device with incorporated projector 10.It should be understood that this control program is stored in anon-volatile memory (not shown in the figures) within the CPU 101.

The memory 102 is used as a working area for the CPU 101. The shortdistance communication unit 103 may comprise, for example, an infraredradiation communication circuit, and transmits and receives data to andfrom an external device upon command by the CPU 101. Furthermore, theexternal interface 106 transmits and receives data to and from anexternal device via a cable or a cradle, not shown in the figures, uponcommand by the CPU 101. And, by using the short distance communicationunit 103 or the external interface 106, it is possible to input varioustypes of image or voice data from an external device.

The memory card 104 comprises a non-volatile memory, and, upon commandby the CPU 101, it is capable of writing, storing, and reading out datasuch as, for example, image data outputted by the camera module 7,images and audio data inputted from an external device via the shortdistance communication unit 103 or the external interface 106, and thelike.

The mike 105 converts audio which has been captured into an electricalsignal and sends it to the CPU 101. This audio signal is recorded in thememory card 104 during sound recording, and is sent to the communicationcontrol unit 108 during telephone conversation. The speaker 111 replaysthe audio of an audio signal outputted from the CPU 101. The actuationkey group 110 summarizes in a single block the various types ofactuation key described above, and sends an actuation signal to the CPU101 corresponding to the actuation key which is depressed. Thecommunication control unit 108 includes a wireless transmission andreception circuit, and performs communication with other telephonedevices via a base station not shown in the figures, upon command by theCPU 101. This communication control unit 108 is adapted so as to be ableto transmit and receive, not only telephone audio, but also image datawhich has been photographed by the camera module 7, image data forprojection by the projector module 6, and the like. And the antenna 109is a transmission and reception antenna for the communication controlunit 110.

The power supply 107 may consist of, for example, a removable batterypack and a DC/DC conversion circuit or the like, and supplies thevarious sections within the portable telephone device with incorporatedprojector 10 with the electrical power which they require. The openingand closing angle sensor 112 detects the rotational angle of the foldinghinge unit 3, in other words the folding angle θ of the portabletelephone device with incorporated projector 10, and sends it to the CPU101.

The main liquid crystal display device 4 and the sub liquid crystaldisplay device 5 each displays information such as an image or text orthe like upon a command from the CPU 101. And, during telephoneconversation, the speaker 201 replays audio which is outputted from theCPU 101 as a sound signal.

The projector module 6 comprises a projection lens 61, a liquid crystalpanel 62, a LED light source 63, a LED drive unit 64, a liquid crystaldrive unit 65, and a lens drive unit 66. The LED drive unit 64 supplieselectrical current to the LED light source 63 according to a LED drivesignal which is outputted from the CPU 101. And the LED light source 63irradiates respective R (red), G (green), and B (blue) primary coloredlight according to the electrical current which is supplied, andilluminates the liquid crystal panel 62 therewith. By synthesizing theselights of various colors, white colored light is irradiated from the LEDlight source 63. It should be understood that the intensities of thesevarious colored R, G, and B lights can be adjusted individuallyaccording to the electrical current intensities from the LED drive unit64.

The liquid crystal drive unit 65 generates a liquid crystal panel drivesignal corresponding to the image data, and, by driving the liquidcrystal panel 62 with this generated drive signal, an image is displayedupon the liquid crystal panel 62. In concrete terms, in the liquidcrystal layer, a voltage is applied to each of the picture elements incorrespondence to the image signal. The arrangement of the liquidcrystal molecules changes in the liquid crystal layer to which voltagehas thus been applied changes, so that the optical transmittance of thisliquid crystal layer changes. The image is displayed due to this changeof transmittance. It should be understood that the liquid crystal panel62 is provided with a color filter, and each of the picture elementscorresponds to one of the colors R, G, and B. Due to this, a color imageis displayed upon the liquid crystal panel 62 by combining these pictureelements of the colors R, G, and B.

The image displayed upon the liquid crystal panel 62 can be selectedfrom among various types of image, such as images stored upon the memorycard 104, images which have been inputted from an external device,images which have been photographed by the camera module 7 as will bedescribed hereinafter, and the like. It would also be acceptable for itto be the same as the image which is being displayed upon the mainliquid crystal display device 4 or the sub liquid crystal display device5, or to be a moving image (a video image). Furthermore, it would alsobe acceptable to arrange for an email document or the like to beselected and displayed.

After displaying an image which has been selected as explained aboveupon the liquid crystal panel 62, white colored light synthesized fromthe lights of the three colors R, G, and B irradiated from the LED lightsource 63 is passed through, so that an optical image of the imagedisplayed upon the liquid crystal panel 62 is created. And the lensdrive unit 66 drives the projection lens 61 forwards and backwards alongthe direction of the optical axis, based upon a control signal outputtedfrom the CPU 101. Adjustment of the focus state of the projection imageis performed by varying the focal point position of the projection lens61 in this manner, as will be explained hereinafter. The projection lens61 projects the optical image emitted from the liquid crystal panel 62towards a projection surface such as a screen or the like. By doingthis, the image which has been selected is projected upon the projectionsurface using the white colored light which has been synthesized fromthe R, G, and Blights, so that a projection image of this image isgenerated.

The camera module 7 comprises the photographic lens 71, an image sensor72, a lens drive unit 73, and a camera control CPU 74. As the imagesensor 72, a CCD or CMOS photographic element or the like may be used.The camera control CPU 74 controls the image sensor 72 and the lensdrive unit 73 upon a command from the CPU 101. And the lens drive unit73 changes the focal point position of the photographic lens 71 bydriving a focal point adjustment lens (not shown in the figures) whichis included in the photographic lens 71 in forwards and backwardsdirection along the optical axis, according to a control signal from thecamera control CPU 74. By doing this, adjustment of the image of theobject to be photographed is performed.

The photographic lens 71 images an image of the object to bephotographed upon the photographic surface of the image sensor 72. Thecamera control CPU 74 starts photography upon the image sensor 72, and,after the end of photography, reads out an accumulated electric chargesignal from the image sensor 72, and, after having performedpredetermined signal processing thereupon, sends it to the CPU 101 asimage data. It should be understood that, when image data which has beenphotographed by the camera module 7 is to be transmitted, image data issent from the CPU 101 to the communication control unit 108.Furthermore, when a photographic image is to be projected, image data issent from the camera control CPU 74 via the CPU 101 to the projectormodule 6. In this manner, a photographic image of the object which hasbeen photographed by the camera module 7 is acquired.

FIG. 3 is a sectional view of the projector module 6. (a) is a figureshowing a sectional view of the projector module 6 in side view, while(b) is an enlarged view thereof. The lens drive unit 73 of FIG. 2comprises a lens support unit 731 and a drive motor 732. The lenssupport unit 731 is arranged above and below the projection lens 61 andsupports it. The drive motor 732 can adjust the gap between the liquidcrystal panel 62 and the LED light source 63, and the projection lens61, by shifting the position of the lens support unit 731 to and fro inthe left and right direction in the figure with its drive operation. Dueto this, it is possible to adjust the focus state of the projectionimage. It should be understood that the LED drive unit 64 and the liquidcrystal drive unit 65 of FIG. 2 are omitted from FIG. 3.

Next, the details of the operation when projecting an image with thisportable telephone device with incorporated projector 10 will beexplained. During the projection of a projection image, this portabletelephone device with incorporated projector 10 repeatedly executesoperation for adjusting the appearance of the projection image on aprojection surface generated by the projector module 6. This calibrationoperation is classified into the following operations: (1) focus stateadjustment; (2) brightness adjustment; (3) white balance adjustment; and(4) trapezoidal deformation compensation. Each of these operations willbe explained in the following in order.

(1) Adjustment of the Focus State

If the focus state of the image projected by the projector module 6 isnot appropriate, in other words if the focal point of the projectedimage is not correctly matched to the distance to the projectionsurface, then the focus is deviated, and the projected image appearsundesirably blurred. In order to project an image whose focus isproperly adjusted, it is necessary to adjust it to an appropriatelyfocused state. This adjustment of the focus state of the projectionimage is performed in the following manner, based upon a photographicimage of the projection image which is acquired by photography with thecamera module 7.

While projecting an image with the projector module 6, this portabletelephone device with incorporated projector 10 photographs theprojection image using the camera module 7. The photographic image ofthe projection image which has been thus acquired with the camera module7 is outputted to the CPU 101. The CPU 101 decides whether or not thefocus state of the projection image is appropriate by detecting anyblurred state of the photographic image outputted from the camera module7. If the photographic image is blurred, then it is decided that thefocus state is not appropriate, and the projection lens 61 is drivenusing the lens drive unit 66. By doing this, and by driving theprojection lens 61 until the blurring of the photographic image iseliminated, the focus state of the projection image is adjusted, so thatit is ensured that an appropriate focus state is established.

The above described adjustment of the focus state may be performed bythe same method as a contrast detection method which is widely used whenadjusting the focal point position of a digital camera. In other words,photographic images are acquired while varying the focal point positionof the projection lens 61 in various manners, and the contrast amount ofeach of these photographic images is calculated. And the contrastamounts of the various photographic images are compared together, andthe focal point position of the projection lens 61 is set to theposition when the photographic image whose contrast amount is maximumwas acquired. By doing this, it is possible to adjust the focus state ofthe projection image in an appropriate manner. It should be understoodthat, although it is necessary to perform focus adjustment and whitebalance adjustment of the camera module 7 at this time, this point willbe explained hereinafter.

However, if the projection image itself varies during adjustment of thefocus state of the projection image, then since the contrast amount ofthe photographic image changes due to this, which is undesirable,accordingly it becomes impossible to obtain a proper adjustment result.In particular, if a moving image is being projected, then, since theprojection image is always changing, it is impossible to adjust thefocus state of the projection image. Thus, with this portable telephonedevice with incorporated projector 10, after a predetermined image forcalculating the contrast amount (hereinafter termed an “image forcontrast calculation”) has been superimposed upon the image which hasbeen selected as the subject for projection, this is projected by theprojector module 6, and the projection image is photographed by thecamera module 7. By doing this, the portion where the image for contrastcalculation is superimposed does not vary, even if the image which isthe original subject for projection varies. Accordingly, by calculatingthe contrast amount for the image for contrast calculation, and byadjusting the focus state of the projection image based upon thiscontrast amount, it is possible to adjust the focus state of theprojection image in an appropriate manner even during projection of amoving image.

FIG. 4 is a figure showing a situation in which an image for contrastcalculation has been superimposed upon the image which is the subjectfor projection. (a) shows the original image which is the subject forprojection, while (b) shows the subject image for projection with theimage for contrast calculation superimposed thereupon. In the image of(b), in addition to the file name and date information in its lower edgeportion, also the image for contrast calculation denoted by thereference symbol 21 is superimposed. This image for contrast calculationhas a pattern of a predetermined shape, in which, in order to make thecontrast amount easy to calculate, a plurality of vertical lines arelined up together. The image which includes the image for contrastcalculation formed by this type of predetermined pattern is projectedupon the projection surface by the projector module 6, and thisprojection image is photographed by the camera module 7. Using thephotographic image which has been acquired in this manner, the contrastamount is calculated based upon the image for contrast calculation 21,and adjustment of the focus state of the projection image is performed.It should be understood that the shape of the pattern of the image forcontrast calculation 21 shown here is only one possible example; it goeswithout saying that it would also be acceptable to employ a pattern ofany shape, provided that it enabled the contrast amount to becalculated.

Moreover, it should be understood that, in the calculation of thecontrast amount as described above, among all the photographic signals(the accumulated electric charge signals) outputted by the pictureelement units in the image sensor 72 of the camera module 7, only thephotographic signals which are outputted by the picture elements in theregion which corresponds to the image for contrast calculation 21 areused.

Here, it is not necessary always to superimpose the image for contrastcalculation as explained above; it would also be acceptable to arrangeto do so for only a predetermined short time period. By doing this, itis possible to make it difficult for a person who is viewing theprojection image to notice that the image for contrast calculation hasbeen superimposed. FIG. 5 is a timing chart for explanation of thissituation. The image which is displayed upon the liquid crystal panel 62is updated once every 1/30 sec, as shown by the reference symbol 31. Inother words, image display of 30 frames is performed during one second.

The superimposition of the image for contrast calculation is performedat fixed frame intervals, at a timing shown by the reference symbol 32.An image which includes this image for contrast calculation is projectedat this timing, and at other timings, the image is projected without theimage for contrast calculation being superimposed thereupon. Moreover,at this time, acquisition of photographic images by the camera module 7is performed at a timing shown by the reference symbol 33. In otherwords, in synchronism with the timing at which the image including theimage for contrast calculation is projected, the projection image isphotographed by the camera module 7. In this manner, calculation of thecontrast amount and adjustment of the focus state of the projectionimage is performed at a timing shown by the reference symbol 34, basedupon the shape pattern portion of the image for contrast calculation inthe photographic image which is photographed.

Furthermore, it would also be acceptable to arrange for the adjustmentof the focus state of the projection image to be performed repeatedly ata fixed cycle, as explained above. Or, it would also be acceptable toarrange for this focus adjustment to be performed repeatedly, each timeinput actuation is performed upon an actuation key of the portabletelephone device with incorporated projector 10. Sometimes, when inputactuation is performed upon an input key, this causes the position orthe orientation of the portable telephone device with incorporatedprojector 10 to change, so that the projection image wobbles.Accordingly, if it is arranged to perform the adjustment of the focusstate of the projection image each time input actuation is performedupon an actuation key, then, even if the projection image has wobbled,it is possible to ensure that the projection image can be compensatedeasily for this.

Or, it would also be acceptable to arrange for it to be possible to setthe frequency of adjustment of the focus state. For example, it may bemade possible to set three types of adjustment frequency, and then, ifthe highest frequency of adjustment has been set, adjustment of thefocus state is performed repeatedly during projection of the projectionimage, as explained above. On the other hand, if the intermediatefrequency of adjustment has been set, then adjustment of the focus stateis only performed during the projection of a projection image for thefirst time; while, if the lowest frequency of adjustment has been set,then it is arranged not to perform adjustment of the focus state of theprojected image. By arranging matters in this manner, it is possible tokeep the consumption of electrical power down when adjustment of thefocus state of the projection image is unnecessary. It should beunderstood that it may be arranged to perform setting of the frequencyof adjustment by input actuation of an actuation key, or the like.

In the explanation described above, it was arranged to adjust the focusstate of the projection image even during projection of a moving image,by superimposing the image for contrast calculation. However, if theimage which is being projected is a still image, then it is possible tocalculate a contrast amount based upon this still image, and to adjustthe focus state of the projection image appropriately. Accordingly, itwould also be acceptable to arrange to adjust the focus state of theprojection image when only the still image is being projected, withoutsuperimposing any image for contrast calculation. Moreover, it wouldalso be possible to arrange to superimpose an image for contrastcalculation during projection of a moving image, while not superimposingany image for contrast calculation during projection of a still image,and to calculate a contrast amount and to adjust the focus state of theprojection image, based upon either the image for contrast calculationor the still image.

(2) Adjustment of the Brightness

Next, the adjustment of the brightness will be explained. Whenprojection is not being performed by the projector module 6 with anappropriate brightness, since the projection image is difficult to viewdue to it being too dark or too bright, which is undesirable,accordingly it is necessary to adjust the brightness of the projectionimage in an appropriate manner. This adjustment of the brightness of theprojection image is performed based upon a photographic imagephotographed and acquired by the camera module 7, in the same manner asthe adjustment of the focus state, previously described.

In this portable telephone device with incorporated projector 10, it isdecided whether or not the brightness of the projection image isappropriate by the brightness of the photographic image outputted fromthe camera module 7 being detected by the CPU 101. If the photographicimage is too dark or too bright overall, then it is decided that thebrightness of the photographic image is not appropriate, and theelectrical current supplied from the LED drive unit 64 to the LED lightsource 63 is increased or decreased. The light emission intensity of theLED light source 63 is varied according to the supply current amountfrom the LED drive unit 64, so that the brightness of the projectionimage varies. By doing this, adjustment is performed so that thebrightness of the projection image becomes appropriate.

It should be understood that, if the LED light source 63 is performingPWM illumination, then it would also be acceptable to arrange to adjustthe brightness of the projection image by varying the duty ratiothereof. In other words, if the LED light source is a light source whichemits light in the form of pulses, then it is possible to make theprojection image brighter by widening this pulse width; and, conversely,it is also possible to make the projection image darker by narrowing thepulse width. Moreover, in a case such as when the LED light source 63emits light of each color of R, G, and B with a plurality of groups, andwhen it is possible to control the turning ON and OFF of illumination byeach group individually, then it is also possible to adjust thebrightness of the projection image by varying the number thereof whichare lit up together. According to the methods explained above, it ispossible to adjust the brightness of the projection image by varying thelight emission amount of, the LED light source 63.

With this portable telephone device with incorporated projector 10, whenadjusting the brightness of the projection image based upon thephotographic image in the manner described above, after havingsuperimposed a predetermined image for detecting the brightness(hereinafter termed the “image for brightness detection”) upon the imagewhich has been selected as a subject for projection, this is projectedwith the projector module 6, and the projection image is photographedwith the camera module 7. By doing this, it is possible to performappropriate adjustment of the brightness of the projection image, basedupon the brightness of the portion over which the image for brightnessdetection is superimposed, even if the original image which is thesubject for projection changes.

FIG. 6 is a figure showing a situation in which an image for brightnessdetection has been superimposed upon the image which is the subject forprojection. (a) shows the original subject for protection image, while(b) shows the image in which the image for brightness detection has beensuperimposed upon this subject for protection image. In the image of(b), in the same manner as in the image of FIG. 4( b) in which the imagefor contrast calculation was superimposed, in its lower edge portion, inaddition to the file name and date information, the image for brightnessdetection shown by the reference symbol 22 is superimposed. This imagefor brightness detection 22 has a pattern in a predetermined shape,which is colorless (i.e. white colored) all over, so that its brightnesscan be detected easily. An image including an image for brightnessdetection formed in a pattern with this type of predetermined shape isprojected upon the projection surface by the projector module 6, andthis projection image is photographed by the camera module 7. Using thephotographic image which has been acquired in this manner, thebrightness thereof is detected based upon the image for brightnessdetection 22, and adjustment of the brightness of the projection imageis performed. It should be understood that the pattern and shape of theimage for brightness detection 22 shown here are given as an example; itgoes without saying that it would also be acceptable to use a patternand shape of any type, provided that it enables brightness detection.

It should be understood that, in the detection of the brightness asdescribed above, among the photographic signals (the accumulatedelectric charge signals) which are outputted by the image sensor 72 ofthe camera module 7 in units of picture elements, only thosephotographic signals are used which are outputted by picture elements inthe region which corresponds to the image for brightness detection 22.

It would also be acceptable, in the same manner as in the case of theimage for contrast calculation described above, to arrange for thesuperimposition of the image for brightness detection to be performed asexplained above for only a predetermined short time period. In thiscase, the projection image would be photographed by the camera module 7in synchrony with the timing at which the image including the image forbrightness detection is projected.

Furthermore, in the same manner as in the case of the adjustment of thefocus state described previously, it would also be acceptable to arrangeto perform this adjustment of the brightness of the projection image aswell repeatedly at a fixed cycle, or to repeat it each time inputactuation is performed upon an actuation key for this portable telephonedevice with incorporated projector 10. This is because, when inputactuation upon an actuation key is performed, sometimes the position orthe orientation of the portable telephone device with incorporatedprojector 10 changes due to this input actuation, so that the distancethereof to the projection surface may vary, which can cause thebrightness of the projection image to vary undesirably. Accordingly, ifit is arranged to perform adjustment of the brightness of the projectionimage each time input actuation is performed upon an actuation key, thenit is possible to ensure that brightness compensation is performed andan easily visible projection image is obtained, even if the brightnessof the projection image changes due to this input actuation.

Or, in the same manner as in the case of the adjustment of the focusstate, it would also be acceptable to arrange for it to be possible toset the frequency of adjustment of the brightness, among three levels ofadjustment frequency, according to the input actuation of an actuationkey. In other words, if the highest frequency of adjustment has beenset, then adjustment of the brightness is performed repeatedly duringprojection of the projection image, as explained above; while, if theintermediate frequency of adjustment has been set, then adjustment ofthe brightness is only performed during the projection of a projectionimage for the first time; and, if the lowest frequency of adjustment hasbeen set, then it is arranged not to perform adjustment of thebrightness of the projected image. By arranging matters in this manner,it is possible to keep the consumption of electrical power down whenadjustment of the brightness of the projection image is unnecessary.

In the above described explanation, it was arranged to adjust thebrightness of the projection image by varying the light emission amountof the LED light source 63. However, it is desirable to keep down thelight emission amount as much as possible, since increase of the lightemission amount entails increase of the amount of electrical powerconsumption and also of the heat generation amount. Accordingly, itwould also be acceptable to arrange to set a predetermined referencevalue for the brightness of the projection image in advance, and toadjust the brightness of the projection image by decreasing the lightemission amount, only when it is desired to make the brightness darkerthan this reference value. In this case, when the brightness is brighterthan the reference value, the brightness of the projection image isadjusted by changing the brightness of the image itself which is thesubject for projection, displayed upon the liquid crystal panel 62. Forchange of the hue at this time, it is possible to use a method of socalled LUT (Look Up Table) processing or gamma compensation processingor the like. In LUT processing, the color information value for eachpicture element in the image data is compensated according to acorrespondence relationship expressed as a table. In gamma compensationprocessing, the color information value for each picture element in theimage data is compensated according to a so called gamma conversioncurve. It should be understood that it would also be acceptable toarrange to change the brightness of the subject image for projectionusing some other type of method.

(3) Adjustment of the White Balance

Next, the adjustment of the white balance will be explained. If the hueof the projection image is not adjusted by the projector module 6,sometimes it happens, due to the ambient light distribution situation orthe hue of the projection surface, that, to the eye viewing theprojection image, it appears to be different from its proper hue, whichis undesirable. Accordingly, it is necessary to perform white balanceadjustment so that the projection image is seen in its proper hue. Thisadjustment of the white balance of the projection image is performedbased upon a photographic image of the projection image, which has beenacquired by photography by the camera module 7, just as in the case ofthe adjustment of the focus state or of the brightness described above.

With this portable telephone device with incorporated projector 10, adecision is made as to whether the white balance of the projection imageis appropriate or not, by the CPU 101 detecting the hue of an imagewhich is photographed by and outputted from the camera module 7. If thedetected hue is different from the proper hue, then the electricalcurrent supplied to the LED light source 63 from the LED drive unit 64is increased or decreased for each of the colors R, G, and B. The lightemission intensity by the LED light source 63 for each of the colors R,G, and B is thus varied individually according to the electrical currentamount supplied from the LED drive unit 64, and thereby the hue of theprojection image is varied. By adjusting the hue in this manner, thewhite balance of the projection image can be adjusted so that it becomesappropriate.

It should be understood that, in the same manner as when adjusting thebrightness as described previously, if the LED light source 63 isperforming PWM illumination, then it would also be acceptable toarranged to adjust the projection image by varying the duty ratio foreach of the colors R, G, and B. In other words, if the LED light sourceis a light source which emits light in pulse form for each of the colorsR, G, and B, then it is possible to make the hue of some light emissioncolor stronger by widening its pulse width, and conversely to make thehue of some light emission color weaker by narrowing its pulse width.Moreover, in a case such as when the LED light source 63 emits light ofeach color of R, G, and B with a plurality of groups, then it is alsopossible to adjust the hue of the projection image by varying the numberthereof which are lit up together. According to the methods explainedabove, it is possible to adjust the hue of the projection image byvarying the light emission amounts of the LED light source 63 for eachof its light emission colors, so that it is possible to performadjustment of the white balance of the projection image.

With this portable telephone device with incorporated projector 10, ifthe white balance of the projection image is adjusted based upon aphotographic image as described above, then, after having superimposed apredetermined image (hereinafter termed the “image for hue detection”)for detecting the hue upon the image which has been selected, this imageis projected by the projector module 6 and the projection image isphotographed with the camera module 7. When this is done, then it ispossible to adjust the white balance of the projection image in anappropriate manner based upon the hue of the portion thereof which isthe image for hue detection which has been superimposed, even if theoriginal image which is the subject for projection changes.

The image for hue detection described above can also serve as the imagefor brightness detection 22 shown in FIG. 6( b). This image for huedetection (image for brightness detection) 22 has a pattern of apredetermined shape, which is all white color. Accordingly, in thephotographic image which has been acquired by the camera module 7, thehue is detected based upon the image for hue detection (image forbrightness detection) 22, and it is possible to perform the whitebalance adjustment by comparing this hue with proper white color. Itshould be understood that it goes without saying that, apart from theabove, a pattern of any shape would also be acceptable, provided that itwas one with which white balance adjustment could be performed. It wouldalso be acceptable to arrange to use a portion in white color upon theimage for contrast calculation which was used for the adjustment of thefocus state of the projection image, also as the image for hue detectionor as the image for brightness detection.

Moreover, it should be understood that, in the detection of huedescribed above, among the photographic signals (the accumulatedelectric charge signals) which are outputted by the picture elementunits in the image sensor 72 of the camera module 7, only thosephotographic signals which are outputted by the picture elements in theregions corresponding to the image for hue detection 22 are used.

It would also be acceptable, in the same manner as with the image forcontrast calculation or the image for brightness detection as describedpreviously, to perform the superimposition of the image for huedetection for only a predetermined short time period. In this case, theprojection image is photographed by the camera module 7 insynchronization with the timing at which the image which includes theimage for hue detection is projected.

Furthermore, it would also be acceptable to arrange for this adjustmentof the white balance to be performed repeatedly at a fixed cycle, aswith the adjustment of the focus state or the adjustment of thebrightness explained above; or, it would also be acceptable to arrangefor this white balance adjustment to be performed repeatedly, each timeinput actuation is performed upon an actuation key of the portabletelephone device with incorporated projector 10. Sometimes, when inputactuation is performed up on an input key, this causes the position orthe orientation of the portable telephone device with incorporatedprojector 10 to change, so that the position of the projection imagechanges. At this time sometimes, due to the position of the projectionimage having changed, the situation with regard to the ambient lightdistribution or the hue of the projection surface changes, and as aresult the color of the projection image, as it appears to the eye ofthe viewer, may change, which is undesirable. Accordingly, if it isarranged to perform the adjustment of the white balance of theprojection image each time input actuation is performed upon anactuation key, then, even if due to this input actuation the hue of theprojection image as seen by the eye of the viewer has changed, it ispossible to compensate the hue, thus producing a projection image whichcan be easily viewed.

Or, it would also be acceptable to arrange for it to be possible to setthe frequency of adjustment of the white balance to any of three typesof adjustment frequency by input actuation of an actuation key, in thesame manner as in the case of adjustment of the focus state oradjustment of the brightness. In other words, if the highest frequencyof adjustment has been set, then adjustment of the white balance isperformed repeatedly during projection of the projection image; and, onthe other hand, if the intermediate frequency of adjustment has beenset, then adjustment of the white balance is only performed during theprojection of a projection image for the first time; while, if thelowest frequency of adjustment has been set, then it is arranged not toperform adjustment of the white balance of the projected image. Byarranging matters in this manner, it is possible to keep the consumptionof electrical power down when adjustment of the white balance of theprojection image is unnecessary.

Although, in the explanation described above, adjustment of the whitebalance was explained, by way of example, as an example of adjustment ofthe hue of the projection image, it would also be acceptable to arrangeto apply this technique to the case of adjusting the hue with referenceto some color other than white.

(4) Compensation of Trapezoidal Deformation

Finally, the compensation of trapezoidal deformation will be explained.By trapezoidal deformation, is meant deformation in a trapezoidal shapeof the projection image, created corresponding to the angle between theprojection direction by the projector module 6 and the projectionsurface. If the projection direction is not straight against theprojection surface, then it is known that so called trapezoidaldeformation is engendered. This compensation of trapezoidal deformationis performed based upon a photographic image of the projection imagewhich is acquired by photography by the camera module 7, in the samemanner as in the case of the various types of adjustment describedabove.

This portable telephone device with incorporated projector 10 decideswhether or not trapezoidal deformation in the projection image isoccurring, by detecting the shape of the photographic image outputtedfrom the camera module 7 with the CPU 101. If trapezoidal deformation isoccurring, then the liquid crystal drive unit 65 is controlled, and theimage displayed upon the liquid crystal panel 62 is distorted in theopposite direction to this trapezoidal deformation, so that thetrapezoidal deformation is cancelled. By projecting this image, thetrapezoidal deformation is compensated.

With this portable telephone device with incorporated projector 10, whencompensating the trapezoidal deformation based upon a photographic imagein the above manner, after having superimposed a predetermined drawingfor specifying the shape of the projection image (hereinafter termed the“drawing for shape specification”) upon the image which has beenselected as the subject for projection, this is projected by theprojector module 6, and the projection image is photographed by thecamera module 7. By doing this, it is possible to compensate thetrapezoidal deformation based upon the drawing for shape specificationwhich has been superimposed, whatever the contents of the subject imagefor projection may be.

FIG. 7 is a figure showing the situation in which a drawing for shapespecification has been superimposed upon an image which is a subject forprojection. (a) shows the original image which is the subject forprojection, while (b) shows an image in which the drawing for shapespecification has been superimposed upon this subject image forprojection. In the image of (b), a drawing for shape specificationformed as a thick frame is superimposed upon the periphery of thesubject image for projection. The image which includes this type ofdrawing for shape specification is projected upon the projection surfaceby the projector module 6, and this projection image is photographed bythe camera module 7. Using the photographic image which has beenacquired in this manner, the shape of the projection image is specifiedbased upon the drawing for shape specification 23, and compensation ofthe trapezoidal deformation is performed. It should be understood thatthe drawing for shape specification 23 shown here is given by way ofexample; it goes without saying that it would also be acceptable toemploy a drawing of any type, provided that it is one which can specifythe shape of the projection image. Or it would also be acceptable toutilize, not a drawing, but a symbol or characters or the like.

It would also be acceptable to perform the superimposition of thedrawing for shape specification as explained above for only apredetermined short time period, as in the case of the image forcontrast calculation, the image for brightness detection, or the imagefor hue detection described above. In this case, the projection imageshould be photographed by the camera module 7 in synchronization withthe timing at which the image including the drawing for shapespecification is projected.

Furthermore, in the same manner as with the various types of adjustmentdescribed above, it would also be acceptable to arrange to perform thiscompensation of trapezoidal deformation repeatedly at a fixed period, orto arrange to perform it repeatedly each time input actuation isperformed to an actuation key of this portable telephone device withincorporated projector 10. When input actuation is performed to anactuation key, sometimes it happen that, due thereto, the position orthe orientation of the portable telephone device with incorporatedprojector 10 changes, so that the angle between the projection directionof the projection image and the projection surface varies, and as aresult sometimes the shape of the trapezoidal deformation changes, whichis undesirable. Accordingly, if the compensation of trapezoidaldeformation is performed each time input actuation to an actuation keyis performed, then, even if due to this input actuation the shape of thetrapezoidal deformation has undesirably changed, still it is possible toobtain a projection image in which the trapezoidal deformation iscompensated, so that it is easy to view.

Or, in the same manner as with the various types of adjustmentpreviously described, it would also be acceptable to arrange for thefrequency of the compensation of trapezoidal deformation to be set toany of three types of adjustment frequency by input actuation of anactuation key. In other words, if the highest frequency of compensationhas been set, then compensation of the trapezoidal deformation isperformed repeatedly during projection of the projection image; and ifthe intermediate frequency of compensation has been set, thencompensation of the trapezoidal deformation is only performed during theprojection of a projection image for the first time; while, if thelowest frequency of compensation has been set, then it is arranged notto perform compensation of trapezoidal deformation. By arranging mattersin this manner, it is possible to keep the consumption of electricalpower down when compensation of the trapezoidal deformation is notrequired.

In the above explanation, it was arranged to perform the compensation oftrapezoidal deformation by superimposing the drawing for shapespecification and photographing an image thereof, and by specifying theshape of the projection image based upon this drawing for shapespecification. However, it would also be acceptable to arrange toperform the compensation of trapezoidal deformation based upon thefolding angle θ which has been detected by the opening and closing anglesensor 112. At this time, it is supposed that the projection directionof the projection image by the projector module 6 is fixed with respectto the display section 2. By doing this, when projection is performedwith the bottom surface portion of the actuation section 1 installedupon a desktop or the like, it is possible to compensate the trapezoidaldeformation in a simple manner even without performing photography.

FIG. 8 is a figure showing, when the actuation section 1 is set upon ahorizontal surface and the projection is performed upon a verticalprojection surface, the relationship between the folding angle θ and thetrapezoidal deformation. (a) is a figure showing in side view thesituation of the projection when the folding angle θ is smaller than90°, while (b) is a figure showing the trapezoidal deformation situationduring (a) in elevation view. And (c) is a figure showing in side viewthe situation of the projection when the folding angle θ is equal to90°, while (d) is a figure showing the trapezoidal deformation situationduring (b) in elevation view.

As shown in FIGS. 8( a) and (b), trapezoidal deformation takes placewhen the folding angle θ is smaller than 90°. Furthermore, conversely tothe above, trapezoidal deformation also takes place when the foldingangle θ is greater than 90°. The extent of this trapezoidal deformation(the degree of deformation) changes according to the folding angle θ,and the proportion by which it changes is determinate. Accordingly, itis possible to compensate such trapezoidal deformation, by setting inadvance the degree of distortion when distorting the image displayedupon the liquid crystal panel 62, in order to cancel the trapezoidaldeformation, according to the value of the folding angle θ. It should beunderstood that, as shown in FIGS. 8( c) and (d), compensation oftrapezoidal deformation is not necessary when θ=90°, since notrapezoidal deformation occurs.

Or, with this portable telephone device with incorporated projector 10,it would also be acceptable to arrange to make the central transverseshaft of the display section 2 as a rotation shaft, to provide aconstruction in which the display section 2 can rotate around thisrotation shaft as a center, to detect this rotational angle with respectto a predetermined reference position, and to perform the compensationof trapezoidal deformation based upon the rotational angle φ which isdetected. It should be understood that, in this case as well, it issupposed that the projection direction of the image projected by theprojector module 6 is fixed with respect to the display section 2.

FIG. 9 is a figure showing, when the actuation section 1 is set upon ahorizontal surface and the projection is performed upon a verticalprojection surface, the relationship between the rotational angle φ ofthe display section 2 and the trapezoidal deformation. (a) is a figureshowing in plan view the situation when performing projection with therotational angle φbeing smaller than 90°, while (b) is a figure showing,in elevation view, the situation of trapezoidal deformation at thistime. Moreover, (c) is a figure showing in plan view the situation whenperforming projection with the rotational angle φ=90°, while (d) is afigure showing, in elevation view, the situation of trapezoidaldeformation during (b). It should be understood that the referenceposition for the rotational angle φ in FIG. 9 is taken as being thecenter of the transverse shaft of the actuation section 1, and that itis assumed that the folding angle θ is 900. When the rotational angle φis 900, the rear surface of the display section 2 is upright.

As shown in FIGS. 9( a) and (b), trapezoidal deformation takes placewhen the rotational angle φ is smaller than 90°. Furthermore, converselyto the above, trapezoidal deformation also takes place when therotational angle φ is greater than 90°. The extent of this trapezoidaldeformation (the degree of deformation) changes according to therotational angle φ, and the proportion by which it changes isdeterminate. Accordingly, it is possible to compensate such trapezoidaldeformation, by setting in advance the degree of distortion whendistorting the image displayed upon the liquid crystal panel 62 in orderto cancel the trapezoidal deformation, according to the value of therotational angle φ, in the same manner as in the case of the foldingangle θ. It should be understood that, as shown in FIGS. 9( c) and (d),compensation of trapezoidal deformation is not necessary when φ=90°,since no trapezoidal deformation occurs.

Furthermore, it would also be acceptable to arrange to employ the abovedescribed compensation of trapezoidal deformation based upon the foldingangle θ, and the above described compensation of trapezoidal deformationbased upon the rotational angle φ, in combination.

As has been explained above, calibration operation is performed byperforming the operations of adjustment of the focus state, adjustmentof the brightness, adjustment of the white balance, and compensation ofthe trapezoidal deformation. It should be understood that it is notnecessary for all of these operations to be performed; it would also beacceptable to arrange for only selected ones of these operations to beexecuted.

Next, the method for adjusting the focus of the photographic image madeby the camera module 7 will be explained. A so called contrast detectionmethod is used for this adjustment of the focus of the photographicimage. In concrete terms, photographic images are acquired while varyingthe focal point position of the photographic lens 71 in various ways,and the contrast amount of each of these photographic images iscalculated. And the contrast amounts of these various photographicimages are compared by the CPU 101, which then outputs a control signalto the camera control CPU 74 so as to drive the focal point position ofthe photographic lens 71 to bring it to the position at which thatphotographic image whose contrast amount is maximum was acquired. Thistype of adjustment of the focus of the photographic image is necessaryfor a photographic image of the projection image to be photographedappropriately, in order to perform the calibration operation.

It would be acceptable to perform this adjustment of the focus of thephotographic image at the same time as the adjustment of the focus stateof the projection image executed by the projector module 6, oralternatively it would also be acceptable for them to be performedseparately. If these focusing operations are performed simultaneously,then the control method which is employed is a so-called same focalpoint shifting method; while, if they are performed separately, then thecontrol method which is employed is a so-called camera fixed method.These control methods will now be explained in the following, in thatorder.

The Same Focal Point Shifting Method

In this control method, the photographic focal point position of thecamera module 7, in other words the focal point position of thephotographic lens 71 with respect to the photographic image, and theprojection focal point position of the projector module 6, in otherwords the focal point position of the projection lens 61 with respect tothe projection image, are changed while being maintained in the samepositional relationship. Here, by the photographic focal point positionand the projection focal point position being in the same positionalrelationship, is meant that the distances of these two focal pointpositions with respect to the portable telephone device withincorporated projector 10 are almost equal. And, projection images aregenerated by the projector module 6 at a plurality of differentprojection focal point positions, and photographic images of thisplurality of projection images are respectively acquired by the cameramodule 7 at a plurality of photographic focal point positions which arestored in the same positional relationship with this plurality ofprojection focal point positions. The respective contrast amounts arecalculated for this plurality of projection images which have beenacquired in this manner, and then the photographic focal point positionand the projection focal point position are adjusted so as to matchtheir positions when the contrast amount attained its maximum. By doingthis, adjustment of the focus of the photographic image and adjustmentof the focus state of the projection image are performed simultaneously.Moreover, at this time, based upon the plurality of photographic imageswhich have been acquired, it would also be acceptable also to executeother calibration operations other than this adjustment of the focusstate of the projection image.

FIG. 10 is a figure showing the situation in which adjustment of thefocus of the photographic image and adjustment of the focus of theprojection image are performed simultaneously using this same focalpoint shifting method explained above. In FIGS. 10( a) through (e), theportable telephone device with incorporated projector 10 is installed ata position about 50 cm from the projection surface. It should beunderstood that it is supposed that, for this projector module 6, about50 cm is the optimum projection distance.

First, as in (a), the photographic focal point position of the cameramodule 7 and the projection focal point position of the projector module6 are both set to a position 60 cm away from the portable telephonedevice with incorporated projector 10. In this state, the projectionimage which is generated by the projector module 6 is photographed bythe camera module 7, and the contrast amount in this photographic imageis calculated. Next, as in (b), the photographic focal point position ofthe camera module 7 and the projection focal point position of theprojector module 6 are both set to a position 55 cm away from theportable telephone device with incorporated projector 10, and thecontrast amount in the photographic image of this projection image iscalculated.

Thereafter, as in (c) through (e), the photographic focal point positionof the camera module 7 and the projection focal point position of theprojector module 6 are both set to, in order, positions 50 cm, 45 cm,and 40 cm away from the portable telephone device with incorporatedprojector 10, and the contrast amounts in the photographic images of theprojection images in these positions are calculated. And thephotographic focal point position of the camera module 7 and theprojection focal point position of the projector module 6 are adjustedto match their positions when the maximum contrast amount was obtained.By doing this, along with performing the adjustment of the focus of thephotographic image, the adjustment of the focus state of the projectionimage is also performed.

As has been explained above, when this same focal point shifting methodis used, the photographic focal point position of the camera module 7and the projection focal point position of the projector module 6 arekept at almost the same distance from the portable telephone device withincorporated projector 10. Now, the closer the projection focal pointposition is to the projection surface, the higher is the contrast of theprojection image which is generated, and the closer is the photographicfocal point position to the projection surface, the higher is thecontrast of the photographic image of the projection image which can beacquired. Accordingly, by using this same focal point shifting method,it is possible to take the difference between the contrast amounts whichare calculated in the focused state and in the non-focused state to begreat, so that it is possible to adjust both the photographic focalpoint position and the projection focal point position together in anaccurate manner. Due to this, it is possible to ensure that theprojection image can be photographed appropriately with the cameramodule 7. It should be understood that, if a yet higher level ofaccuracy is considered to be required, then, after having temporarilyset the photographic focal point position and the projection focal pointposition which have been obtained by a method like the above, the sameprocessing may be repeated while varying the photographic focal pointposition and the projection focal point position in more finely dividedsteps of focal point position around this position as a center.

The Camera Fixed Method

In this control method, only the projection focal point position of theprojector module 6 is varied, in a state in which the photographic focalpoint position of the camera module 7 is kept fixed. And photographicimages are generated of projection images at a plurality of differentprojection focal point positions, with this plurality of photographicimages of projection images being acquired with a single fixedphotographic focal point position. And the contrast amount is calculatedfor each of this plurality of photographic images of projection imageswhich have been acquired in this manner, and the projection focal pointposition of the projector module 6 is adjusted to match its positionwhen the contrast amount attained its maximum.

After having adjusted the projection focal point position in thismanner, if the above described plurality of photographic images ofprojection images which have been acquired by the camera module 7 for asingle photographic focal point position satisfy a predeterminedcondition—in concrete terms, if the maximum contrast amount which hasbeen calculated for this plurality of photographic images of projectionimages is smaller than a predetermined threshold value—then, based uponthis plurality of photographic images of projection images, thephotographic focal point position is adjusted so as to match the sameposition as the projection focal point position, using the maximumcontrast amount which has been calculated. Thereafter, in thisphotographic focal point position after adjustment for a second time,only the projection focal point position is varied, and, in the samemanner as described above, a plurality of projection images aregenerated by the projector module 6, and acquisition of photographicimages of this plurality of projection images is performed by the cameramodule 7 for a second time. The contrast amounts for the photographicimages which have been acquired in this manner are calculated, and theprojection focal point position is adjusted to match the position of themaximum contrast amount. By repeating this type of processing, theadjustment of the focus of the photographic image and the adjustment ofthe focus state of the projection image are performed separately.Furthermore, at this time, based upon the plurality of photographicimages which have been acquired, it would also be acceptable also toexecute other calibration operations other than this adjustment of thefocus state of the projection image.

FIG. 11 is a figure showing the situation in which adjustment of thefocus of the photographic image and adjustment of the focus state of theprojection image are performed separately using the camera fixed methodexplained above. In FIGS. 11( a) through (e), just as in FIG. 10, theportable telephone device with incorporated projector 10 is installed ata position about 50 cm from the projection surface; it is supposed that,for this projector module 6, the optimum projection distance is about 50cm.

First, as in (a), in the state with the photographic focal pointposition of the camera module 7 being set to and fixed at a position 50cm away from the portable telephone device with incorporated projector10, the projection focal point position of the projector module 6 is setto at a position 60 cm away from the portable telephone device withincorporated projector 10. In this state, the projection image which isgenerated by the projector module 6 is photographed by the camera module7, and the contrast amount in this photographic image is calculated.Next, as in (b), with the photographic focal point position fixed justas it is in the same position, the projection focal point position isset to a position 55 cm away from the portable telephone device withincorporated projector 10, and the contrast amount in the photographicimage of this projection image is calculated.

Thereafter, as in (c) through (e), with the photographic focal pointposition of the camera module 7 kept fixed just as it is in a position50 cm away from the portable telephone device with incorporatedprojector 10, the projection focal point position of the projectormodule 6 only is set to, in order, positions 50 cm, 45 cm, and 40 cmaway from the portable telephone device with incorporated projector 10,and the contrast amounts in the photographic images of the projectionimages in these positions are calculated. And the projection focal pointposition of the projector module 6 is adjusted to match its positionwhen the maximum contrast amount was obtained, and a decision is made asto whether or not the value of this maximum contrast amount is greaterthan or equal to a predetermined threshold value which is decided inadvance. If it is greater than or equal to the threshold value, then theadjustment of the focus state of the projection image is terminated. Itshould be understood that it would also be acceptable further to arrangeto subsequently perform focus adjustment of the photographic image ofthe camera module 7.

If the maximum contrast amount is smaller than the threshold value,then, after adjusting the photographic focal point position to match theposition at which this maximum contrast amount was obtained, then theprojection focal point position is changed as explained by (a) through(e) in order for a second time, and photographic images of theseprojection images are obtained by the camera module 7. The contrastamounts of the photographic images thus acquired are calculated, and,after having adjusted the projection focal point position to match theposition at which the maximum contrast amount was obtained, then thismaximum contrast amount and the threshold value are compared togetheragain. By repeating this type of processing, the adjustment of the focusof the photographic image and the adjustment of the focus state of theprojection image are performed separately.

If the camera fixed method as explained above is employed, then, sincethe adjustment of the focus of the image photographed by the cameramodule 7 and the adjustment of the focus state of the image projected bythe projector module 6 are executed separately, therefore it is possibleto perform these two adjustments by a more simple processing procedurethan in the case of the same focal point shifting method. Accordingly,it is possible to enable the camera module 7 to photograph theprojection image in an appropriate manner, even if a CPU whoseprocessing capability is low is used, or the like.

It should be understood that, with the camera fixed method as explainedabove, it would also be acceptable to perform the adjustment of thefocus state of the projection image once only. In other words, it wouldbe acceptable to arrange to finally determine the projection focal pointposition based upon a plurality of photographic images acquired in aphotographic focal point position which was initially fixed, and not torepeat the processing a second time. According to the degree of blurringof the projection image and the depth of field of the image to bephotographed, it is possible to adjust the focus state in an appropriatemanner even in this manner. Furthermore, in this case, it is desirableto keep the photographic focal point position of the camera module 7fixed by maintaining the pan focus state in which the focus of thephotographic image which is acquired is set from close to infinity. Ifthis is done, it is not necessary to repeat the adjustment processingfor the projection focal point position a plurality of times, and it ispossible to adjust the focus state of the projection image within ashort time period, and thus to reach a state in which it is possible tophotograph the projection image in an appropriate manner. It should beunderstood that this type of method for adjustment of the focus state ofthe projection image may also be applied in a case in which the cameramodule 7 is a single focal point camera which is not endowed with anyfocal point adjustment function.

Next, the white balance adjustment method for the image photographed bythe camera module 7 will be explained. With an electronic camera whichphotographs an object to be photographed and acquires a photographicimage thereof, normally, white balance adjustment is performed in orderto match the hues of the photographic images which have been acquired byphotographing various kinds of scenes, to the eye with which a humanbeing views those images. In other words, change of hue of an image ofan object to be photographed which originates due to the ambient lightdistribution situation during photography is suppressed, and the colorinformation values of the photographic image are converted to differentvalues based upon color conversion rules or the like which are stored inadvance, so that the photographic image which is obtained from thisimage of the object to be photographed is expressed in its natural hues.Hues appear in the photographic image according to these colorinformation values after conversion.

With the portable telephone device with incorporated projector 10 ofthis embodiment, as previously described, the photographic image whichis acquired by the camera module 7 is outputted to the CPU 101 as imagedata, and, based upon this image data, the hue of the photographic imageis adjusted by executing conversion processing of the color informationvalues described above by the CPU 101. White balance adjustment of thephotographic image is performed in this manner. It should be understoodthat the details of the color conversion ruses which are used at thistime may be changed over by the user setting a type for the photographicscene.

Furthermore, during photography of a projection image generated by theprojector module 6 with the camera module 7, the type of white balanceadjustment of the photographic image explained above is executedautomatically. In other words, when a projection image is generatedusing the projector module 6, the photographic image is automaticallyacquired by the camera module 7, and white balance adjustment isperformed for this photographic image. In this white balance adjustmentof the photographic image during projection, irrespective of the stateto which the type of the photographic scene is set, the hue of thephotographic image which has been acquired by the camera module 7 isadjusted based upon predetermined color conversion rules which aredetermined upon in advance for projection image photography. It shouldbe understood that these predetermined color conversion rules mentionedhere will be explained hereinafter.

When performing white balance adjustment of the photographic imageduring projection by doing the above, first the LED light source 63 ofthe projector module 6 outputs light which has been adjusted to apredetermined hue which is set in advance. The projection image at thistime is photographed by the camera module 7, and, after white balanceadjustment during projection of the photographic image has beenperformed, calibration operations such as those previously described areexecuted based upon this photographic image after white balanceadjustment. By performing the white balance adjustment of the projectionimage already explained during the calibration operation, the lightemission color of the LED light source 53 is changed to the abovedescribed predetermined hue, so that the hue of the projection image isadjusted.

Here, there are individual differences in hue characteristics duringlight emission between different LED light sources 63 for the projectormodule 6, and, even if as described above light which has been output toa predetermined hue which is set in advance is outputted, the actual hueof this output light will differ minutely between individual cases.Furthermore, if a plurality of different types of this portabletelephone device with incorporated projector 10 exist with differentspecifications, then sometimes the LED light source 63 which is used foreach such device has a different specification. Differences occur in thehue of the output light in this type of case as well, since the huecharacteristics during light emission are different.

Due to this, with the portable telephone device with incorporatedprojector 10 of this embodiment, white balance adjustment of thephotographic image during projection is executed based uponpredetermined color conversion rules which are determined upon inadvance according to the hue characteristics of the LED light source 63.In these predetermined color conversion rules, settings are made so thatthe differences in hue characteristic for different LED light sources 63as explained in the above are compensated. In other words, the huecharacteristics of the LED light sources 63 are measured in advance foreach individual or type of device, and, based upon the results of thismeasurement, color conversion rules which eliminate differences in thehue of the outputted light are stored in the CPU 101 of the portabletelephone device with incorporated projector 10 during manufacture. Byusing this type of color conversion rules, it is possible to compensatedifferences of the hue characteristic between different LED lightsources 63, and it is possible to ensure that the projection image canbe photographed by the camera module 7 in an appropriate manner.

It should be understood that it would also be acceptable to arrange forit to be possible to set the above type of color conversion rules afterthe manufacture of the portable telephone device with incorporatedprojector 10. For example, before projecting an image using theprojector module 6, output light itself, in other words a colorlesstransparent image, may be projected from the LED light source 63 upon awhite colored projection surface in a predetermined hue described above,and this projection image may be photographed with the camera module 7.In this manner, based upon the photographic image which has beenacquired, differences of the hue characteristic of the LED light source63 with respect to a reference characteristic may be detected, and,according to the results of this detection, color conversion rules maybe set to be used in white balance adjustment of photographic imagesduring projection.

According to the first embodiment explained above, the followingbeneficial operational effects are obtained.

(1) It is arranged for the calibration operation by the projector module6 to be executed repeatedly during the projection of the projectionimage by the projector module 6, based upon the photographic image ofthe projection image which has been acquired by photography by thecamera module 7. In concrete terms, it is arranged for the adjustment ofthe focus state of the projection image, the adjustment of thebrightness of the projection image, the adjustment of the hue of theprojection image, and the compensation of trapezoidal deformation of theprojection image, to be executed repeatedly during projection of theprojection image. Since this is done, it is possible to adjust thepicture quality of the projection image in an appropriate manner, evenif the projection image has wobbled during projection due to theorientation of the hand which holds the portable telephone device withincorporated projector 10 having changed, or the like.

(2) By repeatedly executing the calibration operations, in other wordsthe adjustment of the focus state of the projection image, theadjustment of the brightness of the projection image, the adjustment ofthe hue of the projection image, and the compensation of trapezoidaldeformation of the projection image, upon a fixed cycle, it is possiblealways to keep the appearance of the projection image adjusted duringprojection.

(3) It is also possible to execute the calibration operations, in otherwords the adjustment of the focus state of the projection image, theadjustment of the brightness of the projection image, the adjustment ofthe hue of the projection image, and the compensation of trapezoidaldeformation of the projection image, repeatedly each time actuationinput to an actuation key is performed. If this is done, then, even ifdue to the actuation input to an actuation key the position or theorientation of the portable telephone device with incorporated projector10 changes, and the projection image wobbles undesirably, still it ispossible to compensate for this, and accordingly it is possible toobtain a projection image which is easy to view.

(4) Among these calibration operations, it was arranged to perform theadjustment of the focus state of the projection image, the adjustment ofthe brightness of the projection image, and the adjustment of the hue ofthe projection image, based upon patterns of predetermined shapesincluded in the photographic image of the projection image. In concreteterms, it was arranged to adjust the focus state of the projection imagebased upon the image for contrast calculation including a pattern of apredetermined shape, to adjust the brightness of the projection imagebased upon the image for brightness detection including a pattern of apredetermined shape, and to adjust the hue of the projection image basedupon the image for hue detection including a pattern of a predeterminedshape. Since this is done, it is possible to adjust the focus state, thebrightness, and the hue of the projection image during projection.

(5) Furthermore, among these calibration operations, it was arranged toperform compensation of trapezoidal deformation of the projection image,based upon a predetermined drawing or symbol for specifying the shape ofthe projection image, included in the photographic image of theprojection image. Since this is done, it is possible to compensate thetrapezoidal deformation of the projection image even during projection.

(6) By arranging to project the image including the pattern of apredetermined shape, or the image including the predetermined drawing orsymbol, for only a predetermined short time period, and by photographingthe projection image as an object to be photographed in synchronizationwith the projection timing of that image, it is possible to make itdifficult to notice this pattern of a predetermined shape or drawing orsymbol, from the point of view of a person viewing the projection image.

(7) It is also possible to set the frequency of the calibrationoperation, in other words of the adjustment of the focus state of theprojection image, of the adjustment of the brightness of the projectionimage, of the adjustment of the hue of the projection image, and of thecompensation of trapezoidal deformation of the projection image. And itmay made possible to arrange to set this frequency to one of three typesof frequency, and to execute these calibration operations repeatedlyduring projection of the projection image if the highest frequency isset, to execute these calibration operations only once during projectionof the projection image if the intermediate frequency is set, and not toexecute these calibration operations if the lowest frequency is set. Ifthis is done, then it is possible to keep down the consumption ofelectrical power if the type of calibration operation described above isnot required.

(8) When a still image is being projected, it is also possible to adjustthe focus state of the projection image based upon a photographic imagewhich has been acquired by photographing that projection image. It isalso possible to adjust the focus state of the projection image duringprojection by doing this.

(9) Furthermore, in the case described above, when a moving image isbeing projected, it is also possible to project an image which includesan image for contrast calculation having a pattern of a predeterminedshape. If this is done, then it is possible to adjust the focus state ofthe projection image during projection, even during the projection of amoving image.

(10) Since it is arranged to adjust the brightness of the projectionimage by changing the light emission amount from the LED light source63, accordingly it is possible to adjust the brightness of theprojection image by a simple process. Furthermore it is also possible,if at this time the image is darker than a predetermined referencevalue, to adjust the brightness of the projection image by decreasingthe light emission amount from the LED light source 63, and, if it isbrighter than a predetermined reference value, to adjust the brightnessof the projection image by varying the actual brightness of the imagewhich is displayed upon the liquid crystal panel 62. If this is done,then it is possible to reduce the amount of consumption of electricalpower and the amount of heat generated, by keeping down the amount oflight emission.

(11) Since it is possible to adjust the hue of the projection image bychanging the amount of light emitted from the LED light source 63 foreach of its R, G, and B light emission colors, accordingly it ispossible to adjust the hue of the projection image by a simple process.

(12) It may be arranged to detect the folding angle θ of the actuationsection 1 and the display section 2, and to compensate the trapezoidaldeformation based upon this detected folding angle θ. Or, it may bearranged to detect the rotational angle φ of the display section 2, andto compensate the trapezoidal deformation based upon this detectedrotational angle φ. It is possible to compensate the trapezoidaldeformation with a simple control sequence by doing this, since itbecomes unnecessary to perform photography of the projection. imageusing the camera module 6.

(13) If the same focal point shifting method is used for adjusting thefocus of the photographic image, then respective projection images arecreated by the projector module 6 at a plurality of different projectionfocal point positions, and photographic images of this plurality ofprojection images are acquired by the camera module 7. At this time, itis arranged to acquire these photographic images of this plurality ofprojection images at a respective plurality of photographic focal pointpositions at which the distances with respect to the portable telephonedevice with incorporated projector 10 is respectively almost equal tothose at the plurality of projection focal point positions at which theprojection images were created. Since this is done, it is possible toensure that the projection images can be photographed in an appropriatemanner with the camera module 7.

(14) If the camera fixed method is used for adjusting the focus of thephotographic image, then projection images are created by the projectormodule 6 at a plurality of different projection focal point positions,and photographic images of this plurality of projection images areacquired by the camera module 7. At this time, it is arranged for thisplurality of photographic images of the projection images all to beacquired at a single fixed photographic focal point position. In thismanner as well, it is possible to ensure that the projection images canbe photographed in an appropriate manner with the camera module 7.

(15) If the camera fixed method is used, then, furthermore, if theplurality of photographic images of the projection images which havebeen acquired at the single photographic focal point position satisfysome predetermined condition, then, after having adjusted thephotographic focal point position based upon this plurality ofphotographic images of these projection images, a plurality ofprojection images are generated by the projector module 6, and it isarranged, for a second time, to perform acquisition by the camera module7 of a plurality of photographic images of these projection images atthis photographic focal point position after adjustment. Since this isdone, it is possible to enable photography of the projection images atthe photographic focal point position after adjustment in an appropriatemanner, even if the photographic focal point position which wasinitially fixed was not appropriate.

(16) Furthermore, if the camera fixed method is used, then, if it isarranged to fix the photographic focal point position by the cameramodule 7 so that it is in a pan focus state in which the focus of thephotographic image which is acquired is matched from close up toinfinity, and to acquire a plurality of photographic images of theprojection images at this photographic focal point position, then it isnot necessary to repeat the adjustment processing for the projectionfocal point position a plurality of times, and it is possible to make itpossible to perform photography of the projection images in anappropriate manner, in a short time period.

(17) In the white balance adjustment of the photographic image duringprojection, it was arranged, while photographing the projection imagewith the camera module 7, to adjust the hue of the acquired photographicimage based upon predetermined color conversion rules which aredetermined according to the hue characteristics of the LED light source63 in advance. Since this is done, it is possible to enable photographyof the projection image with the camera module 7 in an appropriatemanner, even while performing white balance adjustment of thephotographic image, in other words adjustment of the hue of thephotographic image.

Second Embodiment

A second embodiment of the present invention will now be explained. Inthis embodiment, a zoom function is provided to the camera module 7, andduring photography, upon actuation by the user, the camera can beshifted to any desired zoom position. Due to this, it is possible forthe user to perform photography while magnifying or shrinking an objectto be photographed. It should be understood that the external appearanceand structure of this embodiment are the same as those of the firstembodiment, and accordingly explanation thereof will here be omitted.

In this embodiment, the photographic lens 71 of the camera module 7 is azoom lens which is capable of zooming, and its zoom position iscontrolled by being driven by a lens drive unit 73, based upon controlby the camera control CPU 74. During photography of a projection imageby the camera module 7, the camera control CPU 74 controls the zoomposition of the photographic lens 71 so that it reaches a predeterminedzoom position which is set in advance. In other words, when generating aprojection image using the projector module 6, the photographic lens 71is automatically controlled to the predetermined zoom position by thecamera module 7, for acquisition of the photographic image. Thepredetermined zoom position at this time is set that at least thephotographic range of the camera module 7 includes the projection rangeby the projector module 6 of the projection images. It should beunderstood that the projection range of the projection images fluctuatesaccording to the distance between the portable telephone device withincorporated projector 10 and the projection surface. Accordingly, it isdesirable to set the predetermined zoom position in consideration ofthis fluctuation amount, so that the photographic range is the largerthereof.

The camera module 7 photographs the projection image which is generatedby the projector module 6 with the photographic range when the abovedescribed predetermined zoom position is set. Based upon thisphotographic image, the calibration operation previously described isperformed by the CPU 101 and the projector module 6, and the picturequality of the projection image is adjusted.

FIG. 12 is a figure showing the situation when the zoom position of thecamera module 7 is controlled so that the photographic range includesthe projection range. The plan view of (a) and the elevation view of (b)are figures showing the relationship between the photographic range andthe projection range before control of the zoom position is performed.The photographic range by the camera module 7 at this time is narrowerthan the projection range by the projector module 6. Since it is notpossible to photograph the entire projection image in this state,accordingly during projection the zoom position is controlled so as tomagnify the photographic range.

The plan view of (c) and the elevation view of (d) are figures showingthe relationship between the photographic range and the projection rangeafter control to the predetermined zoom position has been performed. Atthis time, the photographic range of the camera module 7 is magnified bypulling back the zoom position more than in the state of (a) and (b), sothat the photographic range is magnified so as to include the projectionrange by the projector module 6. The zoom position is controlled in thismanner. It should be understood that, if the zoom position is to theside at which the photographic range is more magnified than thepreviously described predetermined zoom position, then it would beacceptable to perform control so as to bring about the predeterminedzoom position, in the same manner as described above; or, alternatively,it would also be acceptable not to change the zoom position, but toleave it just as it is.

According to the second embodiment explained above, when the projectionimage is being photographed by the camera module 7, it is arranged tocontrol the zoom position of the camera module 7 by the camera controlCPU 74 to the predetermined zoom position which is set in advance, sothat the photographic range of the camera module 7 at least includes theprojection range of the projection image. Since this is done, it ispossible to ensure that it is possible to perform photography of theprojection image in an acceptable manner, even if a zoom mechanism isprovided to the camera module 7.

It should be understood that, in the above described first and secondembodiments, it would also be acceptable to arrange for the CPU 101 tostore various types of setting states of the camera module 7 beforephotographing the projection image with the camera module 7, and toreturn these various types of setting state to these stored states,after the generation of the projection image by the projector module 6has stopped, or after the execution of the calibration operation hasstopped. Here, in the first embodiment, the state of the photographicfocal point position or the state of the color conversion rules usedduring white balance adjustment of the photographic image corresponds tothese various types of setting state; while, in the second embodiment,the state of the zoom position corresponds thereto. It should beunderstood that it goes without saying that, in this case, the colorconversion rules which are used during white balance adjustment of thephotographic image are different, when the projection image is beingphotographed by the camera module 7, and when it is not thus beingphotographed.

Third Embodiment

A third embodiment of the present invention will now be explained. FIG.13 is a figure showing the external appearance of a portable telephonedevice with incorporated projector 10A according to this embodiment. (a)and (b) show a side view thereof, while (c) shows a rear view. In thisportable telephone device with incorporated projector 10A, the actuationsection 1 and the display section 2A have the same structures as in thefirst embodiment. And a projector module 6 and a camera module 7 areprovided to the display section 2A, disposed in positions shown in thefigure, while the sub-liquid crystal display device 5 of FIG. 1 is notincorporated. Apart from these points, the display section 2 is the sameas in the first embodiment.

The camera module 7 is provided in a camera fitting mechanism portion 2Bof the display section 2A. This camera fitting mechanism portion 2Bcomprises a rotatable mechanism for changing the photographic directionof the camera module 7. Due to this, sometimes the photographicdirection of the camera module 7 and the projection direction of theprojector module 6 are the same direction, as shown in (b), andsometimes they are not the same direction, as shown in (a). When theyare not the same, as shown in (a), then, when an image is beingprojected by the projector module 6, since it is not possible tophotograph this projection image with the camera module 7, accordinglycalibration operations as previously described are not executed.

Due to this, in this embodiment, it is arranged to provide a rotationalangle detection unit (not shown in the figures) to the display section2A for detecting the rotational angle of the camera fitting mechanism2B, and the photographic direction of the camera module 7 is decidedupon according to this rotational angle. And a decision is made by theCPU 101 as to whether or not the photographic direction of the cameramodule 7 and the projection direction of the projector module 6 are thesame, and the CPU 101 permits the operation of the projector module 6only if it has been decided that they are the same.

If the result of the decision described above is that the photographicdirection and the projection direction are not the same direction, then,along with the operation of the projector module 6 being prohibited bythe CPU 101, also a warning is issued in order to urge the user tochange the photographic direction of the camera module 7. This warningmay be displayed as a warning message upon the main liquid crystaldisplay device 4, or may be outputted as a warning noise from thespeaker 111. It should be understood that it would also be acceptable toarrange only to execute one or the other of the above described controlto permit or prevent the operation of the projector module 6, and theoutput of a warning noise.

According to the third embodiment explained above, the followingbeneficial operational effects are obtained.

(1) Since it is arranged to decide whether or not the projectiondirection of the projector module 6 and the photographic direction ofthe camera module 7 are the same direction, and to issue a warning if ithas been decided that they are not the same direction, accordingly it ispossible to make it possible to perform photography of the projectionimage in an appropriate manner, even in this case in which thephotographic direction of the camera module 7 is variable.

(2) Furthermore, it is arranged to permit the operation of the projectormodule 6 only if it has been decided that the projection direction ofthe projector module 6 and the photographic direction of the cameramodule 7 are the same direction. By doing this, also, it is possible tomake it possible to perform photography of the projection image in anappropriate manner, even in this case in which the photographicdirection of the camera module 7 is variable.

It should be understood that, in the various embodiments describedabove, portable telephone devices with incorporated projectors have beenexplained as examples of the provision of a projector function to aportable telephone device. However any kind of compact portable typeelectronic device which is endowed with a projector function and acamera function would also be acceptable; provided that the projectordevice is capable of performing operations like those described above,it is not limited to being installed in a portable telephone device. Or,it would also be acceptable to install a projector function upon anelectronic camera such as a digital still camera or the like, and toperform operations like those described above thereupon.

Although the details of various embodiments have been explained in theabove description, the present invention is not to be considered asbeing limited by the contents thereof. Other modes which are consideredto lie within the range of the technical concept of the presentinvention are also included within its scope.

The contents of the disclosure of the following patent applications,upon which priority is based, are hereby incorporated by reference:

Japanese Patent Application No. 2004-273417 (filed on 21 Sep. 2004);

Japanese Patent Application No. 2004-273427 (filed on 21 Sep. 2004);

Japanese Patent Application No. 2004-273428 (filed on 21 Sep. 2004);

Japanese Patent Application No. 2004-273429 (filed on 21 Sep. 2004);

Japanese Patent Application No. 2004-273433 (filed on 21 Sep. 2004); and

Japanese Patent Application No. 2004-273435 (filed on 21 Sep. 2004).

1. A projector device that generates a projection image, photographsthis projection image and performs various adjustments to the projectionimage.
 2. A projector device according to claim 1, comprising: aprojection image generation device that projects an image upon aprojection surface and generates a projection image of the image; aphotographic device that photographs an object to be photographed andacquires a photographic image of the object; and a calibration controldevice that repeatedly executes calibration operation for adjusting anappearance of the projection image on the projection surface duringprojection of the projection image, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device.
 3. A projector device according to claim 2, whereinthe calibration control device repeatedly executes the calibrationoperation upon a fixed cycle.
 4. A projector device according to claim2, further comprising an actuation input device for receiving actuationinput from a user; and wherein the calibration control device repeatedlyexecutes the calibration operation each time actuation input isperformed to the actuation input device.
 5. A projector device accordingto claim 2, wherein: the projection image generation device projects animage which includes a predetermined shape pattern; and the calibrationcontrol device executes the calibration operation based upon thepredetermined shape pattern which is included in a photographic image ofthe projection image.
 6. A projector device according to claim 5,wherein: the projection image generation device projects the imageincluding the predetermined shape pattern for a predetermined short timeperiod; and the photographic device photographs the projection image asan object to be photographed in synchronization with projection timingof the image.
 7. A projector device according to claim 2, furthercomprising a setting device that sets a frequency for execution of thecalibration operation; and wherein the calibration control device: whena first execution frequency is set by the setting device, repeatedlyexecutes the calibration operation during the projection of theprojection image; when a second execution frequency is set, executes thecalibration operation only once during projection of the projectionimage; and when a third execution frequency is set, does not execute thecalibration operation.
 8. A projector device according to claim 1,comprising: a projection image generation device that projects an imageincluding a predetermined shape pattern upon a projection surface andgenerates a projection image of the image; a photographic device thatphotographs an object to be photographed and acquires a photographicimage of the object; and a focusing device that adjusts a focus state ofthe projection image based upon the predetermined shape pattern includedin the photographic image of the projection image which is acquired byphotography by the photographic device.
 9. A projector device accordingto claim 1, comprising: a projection image generation device thatprojects either one of a still image and a moving image upon aprojection surface and generates a projection image of the still imageor the moving image; a photographic device that photographs an object tobe photographed and acquires a photographic image of the object; and afocusing device that, when the still image is projected by theprojection image generation device, adjusts a focus state of theprojection image based upon the photographic image of the projectionimage which is acquired by photography by the photographic device.
 10. Aprojector device according to claim 9, wherein: when projecting themoving image, the projection image generation device includes apredetermined shape pattern in the moving image during projection; andwhen the moving image in which the predetermined shape pattern isincluded is projected by the projection image generation device, thefocusing device adjusts the focus state of the projection image basedupon the predetermined shape pattern which is included in thephotographic image of the projection image.
 11. A projector deviceaccording to claim 8, wherein the focusing device repeatedly performsthe adjustment of the focus state of the projection image during theprojection of the projection image.
 12. A projector device according toclaim 11, wherein the focusing device repeatedly performs the adjustmentof the focus state of the projection image upon a fixed cycle.
 13. Aprojector device according to claim 11, further comprising an actuationinput device for receiving actuation input from a user; and wherein thefocusing device repeatedly performs the adjustment of the focus state ofthe projection image each time actuation input is performed to theactuation device.
 14. A projector device according to claim 8, wherein:the projection image generation device projects the image including thepredetermined shape pattern for a predetermined short time period; andthe photographic device photographs the projection image as the objectto be photographed in synchronization with projection timing of theimage.
 15. A projector device according to claim 11, further comprisinga setting device that sets a frequency of adjustment of the focus stateof the projection image; and wherein the focusing device: when a firstfrequency of adjustment is set by the setting device, performsadjustment of the focus state of the projection image repeatedly duringthe projection of the projection image; when a second frequency ofadjustment is set, performs adjustment of the focus state of theprojection image only once during the projection of the projectionimage; and when a third frequency of adjustment is set, does not performadjustment of the focus state of the projection image.
 16. A projectordevice according to claim 1, comprising: a projection image generationdevice that projects an image including a predetermined shape patternupon a projection surface and generates a projection image of the image;a photographic device that photographs an object to be photographed andacquires a photographic image of the object; and a brightness adjustmentdevice that adjusts a brightness of the projection image based upon thepredetermined shape pattern included in the photographic image of theprojection image which is acquired by photography by the photographicdevice.
 17. A projector device according to claim 1, comprising: aprojection image generation device that comprises a light source,projects an image by using light emitted from the light source upon aprojection surface and generates a projection image of the image; aphotographic device that photographs an object to be photographed andacquires a photographic image of the object; and a brightness adjustmentdevice that adjusts a brightness of the projection image based upon thephotographic image of the projection image which is acquired byphotography by the photographic device, by varying amount of lightemission from the light source.
 18. A projector device according toclaim 17, wherein the brightness adjustment device: if the brightness ofthe projection image is darker than a predetermined reference value,adjusts the brightness of the projection image by decreasing the amountof light emission from the light source; and if the brightness of theprojection image is brighter than the reference value, adjusts thebrightness of the projection image by changing brightness of the imagebeing projected.
 19. A projector device according to claim 16, whereinthe brightness adjustment device repeatedly performs the adjustment ofthe brightness of the projection image during the projection of theprojection image.
 20. A projector device according to claim 19, whereinthe brightness adjustment device repeatedly performs the adjustment ofthe brightness of the projection image upon a fixed cycle.
 21. Aprojector device according to claim 19, further comprising an actuationinput device for receiving actuation input from a user; and wherein thebrightness adjustment device repeatedly performs the adjustment of thebrightness of the projection image each time actuation input isperformed to the actuation device.
 22. A projector device according toclaim 16, wherein: the projection image generation device projects theimage including the predetermined shape pattern for a predeterminedshort time period; and the photographic device photographs theprojection image as the object to be photographed in synchronizationwith projection timing of the image.
 23. A projector device according toclaim 19, further comprising a setting device that sets a frequency ofadjustment of the brightness of the projection image; and wherein thebrightness adjustment device: when a first frequency of adjustment isset by the setting device, performs adjustment of the brightness of theprojection image repeatedly during the projection of the projectionimage; when a second frequency of adjustment is set, performs adjustmentof the brightness of the projection image only once during theprojection of the projection image; and when a third frequency ofadjustment is set, does not perform adjustment of the brightness of theprojection image.
 24. A projector device according to claim 1,comprising: a projection image generation device that projects an imageincluding a predetermined shape pattern upon a projection surface andgenerates a projection image of the image; a photographic device thatphotographs an object to be photographed and acquires a photographicimage of the object; and a hue adjustment device that adjusts the hue ofthe projection image based upon the predetermined shape pattern includedin the photographic image of the projection image which is acquired byphotography by the photographic device.
 25. A projector device accordingto claim 1, comprising: a projection image generation device thatcomprises a light source which emits light of a plurality of colors,projects an image by using light synthesized from the light of variouscolors emitted from the light source upon a projection surface andgenerates a projection image of the image; a photographic device thatphotographs an object to be photographed and acquires a photographicimage of the object; and a hue adjustment device that adjusts a hue ofthe projection image based upon the photographic image of the projectionimage which is acquired by photography by the photographic device, byvarying amount of light emission from the light source for each of itslight emitting colors.
 26. A projector device according to claim 24,wherein the hue adjustment device repeatedly performs the adjustment ofthe hue of the projection image during the projection of the projectionimage.
 27. A projector device according to claim 26, wherein the hueadjustment device repeatedly performs the adjustment of the hue of theprojection image upon a fixed cycle.
 28. A projector device according toclaim 26, further comprising an actuation input device for receivingactuation input from a user; and wherein the hue adjustment devicerepeatedly performs the adjustment of the hue of the projection imageeach time actuation input is performed to the actuation device.
 29. Aprojector device according to claim 24, wherein: the projection imagegeneration device projects the image including the predetermined shapepattern for a predetermined short time period; and the photographicdevice photographs the projection image as the object to be photographedin synchronization with projection timing of the image.
 30. A projectordevice according to claim 26, further comprising a setting device thatsets a frequency of adjustment for the hue of the projection image; andwherein the hue adjustment device: when a first frequency of adjustmentis set by the setting device, performs adjustment of the hue of theprojection image repeatedly during the projection of the projectionimage; when a second frequency of adjustment is set, performs adjustmentof the hue of the projection image only once during the projection ofthe projection image; and when a third frequency of adjustment is set,does not perform adjustment of the hue of the projection image.
 31. Aprojector device according to claim 1, comprising: a projection imagegeneration device that projects an image including a predetermineddrawing or symbol for specifying a shape of a projection image upon aprojection surface and generates a projection image of the image; aphotographic device that photographs an object to be photographed andacquires a photographic image of the object; and a trapezoidalcompensation device that compensates trapezoidal deformation of theprojection image created according to an angle between a projectiondirection of the projection image generation device and the projectionsurface, based upon the drawing or symbol included within thephotographic image of the projection image which is acquired byphotography by the photographic device.
 32. A projector device accordingto claim 31, wherein the trapezoidal compensation device repeatedlyperforms the compensation of the trapezoidal deformation during theprojection of the projection image.
 33. A projector device according toclaim 31, wherein the trapezoidal compensation device repeatedlyperforms the compensation of the trapezoidal deformation upon a fixedcycle.
 34. A projector device according to claim 32, further comprisingan actuation input device for receiving actuation input from a user; andwherein the trapezoidal compensation device repeatedly performs thecompensation of the trapezoidal deformation each time actuation input isperformed to the actuation device.
 35. A projector device according toclaim 31, wherein: the projection image generation device projects theimage including the drawing or symbol for a predetermined short timeperiod; and the photographic device photographs the projection image asthe object to be photographed in synchronization with projection timingof the image.
 36. A projector device according to claim 32, furthercomprising a setting device that sets a frequency of compensation of thetrapezoidal deformation; and wherein the trapezoidal compensationdevice: when a first frequency of adjustment is set by the settingdevice, performs compensation of the trapezoidal deformation repeatedlyduring the projection of the projection image; when a second frequencyof adjustment is set, performs compensation of the trapezoidaldeformation only once during the projection of the projection image; andwhen a third frequency of adjustment is set, does not performcompensation of the trapezoidal deformation.
 37. A projector deviceaccording to claim 1, comprising: a projection image generation devicewhose projection focal point position is variable, that projects animage upon a projection surface and generates a projection image of theimage; a photographic device whose photographic focal point position isvariable, that photographs an object to be photographed and acquires aphotographic image of the object; and a calibration control device thatexecutes a calibration operation for adjusting an appearance of theprojection image upon the projection surface, based upon thephotographic image of the projection image which is acquired byphotography by the photographic device; and wherein: the projectionimage generation device generates the projection images for a pluralityof different projection focal point positions; the photographic deviceacquires the photographic images of the plurality of projection imageswhich is generated by the projection image generation device at theplurality of projection focal point positions, respectively at aplurality of photographic focal point positions at which the distanceswith respect to the projector device are respectively almost equal tothose at the plurality of projection focal point positions; and thecalibration control device executes the calibration operation based uponthe photographic images of the plurality of projection images which isacquired by the photographic device at the plurality of photographicfocal point positions.
 38. A projector device according to claim 1,comprising: a projection image generation device whose projection focalpoint position is variable, that projects an image upon a projectionsurface and generates a projection image of the image; a photographicdevice whose photographic focal point position is variable, thatphotographs an object to be photographed and acquires a photographicimage of the object; and a calibration control device that executes acalibration operation for adjusting an appearance of the projectionimage upon the projection surface, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device; and wherein: the projection image generation devicegenerates the projection images for a plurality of different projectionfocal point positions; the photographic device acquires the photographicimages of the plurality of projection images which is generated by theprojection image generation device at the plurality of projection focalpoint positions, all at a single fixed photographic focal pointposition; and the calibration control device executes the calibrationoperation based upon the photographic images of the plurality ofprojection images which is acquired by the photographic device at thesingle photographic focal point position.
 39. A projector deviceaccording to claim 38, wherein: if the photographic images of theplurality of projection images which is acquired by the photographicdevice at the single photographic focal point position satisfy apredetermined condition, after adjusting the photographic focal pointposition based upon the photographic images of the plurality ofprojection images, the generation of the plurality of projection imagesby the projection image generation device and the acquisition of thephotographic images of the plurality of projection images by thephotographic device are performed for a second time, with thephotographic focal point position after adjustment.
 40. A projectordevice according to claim 38, wherein the photographic device acquireseach of the photographic images of the plurality of projection images byfixing the photographic focal point position, so as to obtain a panfocus state in which the focus of the photographic images which areacquired is set from close to infinity.
 41. A projector device accordingto claim 1, comprising: a projection image generation device thatprojects an image upon a projection surface and generates a projectionimage of the image; a photographic device that is capable of zooming,photographs an object to be photographed and acquires a photographicimage of the object; a zooming control device that controls a zoomposition of the photographic device; and a calibration control devicethat executes a calibration operation for adjusting an appearance of theprojection image upon the projection surface, based upon thephotographic image of the projection image which is acquired byphotography by the photographic device; and wherein: when photographingthe projection image by the photographic device, the zooming controldevice controls the zoom position of the photographic device to apredetermined zoom position which is set in advance, so that aphotographic range of the photographic device includes at least aprojection range of the projection image.
 42. A projector deviceaccording to claim 1, comprising: a projection image generation devicethat comprises a light source which emits light of a predetermined huecharacteristic, projects an image by using light emitted from the lightsource upon a projection surface and generates a projection image of theimage; a photographic device that photographs an object to bephotographed and acquires a photographic image of the object; a hueadjustment device that adjusts a hue of the photographic image; and acalibration control device that executes a calibration operation foradjusting an appearance of the projection image upon the projectionsurface, based upon the photographic image of the projection image whichis acquired by photography by the photographic device; and wherein: whenphotographing the projection image by the photographic device, the hueadjustment device adjusts the hue of the acquired photographic imagebased upon predetermined color conversion rules set in advance accordingto the hue characteristics of the light source.
 43. A projector deviceaccording to claim 37, further comprising a state storage device thatstores a state of the photographic focal point position before theprojection image is photographed by the photographic device; andwherein, after the generation of the projection image by the projectionimage generation device is stopped, or after the execution of thecalibration operation by the calibration control device is stopped, thephotographic focal point position is returned to its state stored by thestate storage device.
 44. A projector device according to claim 41,further comprising a state storage device that stores a state of thezoom position before the projection image is photographed by thephotographic device; and wherein, after the generation of the projectionimage by the projection image generation device is stopped, or after theexecution of the calibration operation by the calibration control deviceis stopped, the zoom position is returned to its state stored by thestate storage device.
 45. A projector device according to claim 42,further comprising a state storage device that stores a state of colorconversion rules by the hue adjustment device before the projectionimage is photographed by the photographic device; and wherein: when theprojection image is not being photographed by the photographic device,the hue of the photographic image is adjusted by the hue adjustmentdevice, based upon color conversion rules which are different from thepredetermined color conversion rules; and after the generation of theprojection image by the projection image generation device is stopped,or after the execution of the calibration operation by the calibrationcontrol device is stopped, the state of the color conversion rules forthe hue adjustment device is returned to its state stored by the statestorage device.
 46. A projector device according to claim 1, comprising:a projection image generation device that projects an image upon aprojection surface and generates a projection image of the image; aphotographic device that photographs an object to be photographed andacquires a photographic image of the object; a photographic directionchange mechanism that changes a photographic direction of thephotographic device; a calibration control device that executes acalibration operation for adjusting an appearances of the projectionimage upon the projection surface, based upon the photographic image ofthe projection image which is acquired by photography by thephotographic device; a decision device that decides whether or not aprojection direction of the projection image generation device and thephotographic direction of the photographic device are the samedirection; and a warning device that emits a warning when it is decidedby the decision device that the projection direction and thephotographic direction are not the same direction.
 47. A projectordevice according to claim 1, comprising: a projection image generationdevice that projects an image upon a projection surface and generates aprojection image of the image; a photographic device that photographs anobject to be photographed and acquires a photographic image of theobject; a photographic direction change mechanism that changes aphotographic direction of the photographic device; a calibration controldevice that executes a calibration operation for adjusting an appearanceof the projection image upon the projection surface, based upon thephotographic image of the projection image which is acquired byphotography by the photographic device; a decision device that decideswhether or not the projection direction of the projection imagegeneration device and the photographic direction of the photographicdevice are the same direction; and an operation permission device thatpermits an operation of the projection image generation device only ifit is decided by the decision device that the projection direction andthe photographic direction are the same direction.
 48. A projectordevice, comprising: a body portion that has a construction to be foldedaround a hinge unit as a center and comprises a first portion and asecond portion which are linked by the hinge unit; a detection devicethat detects a folding angle of the body portion; a projection imagegeneration device that projects an image upon a projection surface andgenerates a projection image of the image, whose projection direction isfixed with respect to the first portion; and a trapezoidal compensationdevice that compensates trapezoidal deformation of the projection imagecreated according to an angle between the projection direction of theprojection image generation device and the projection surface, basedupon the folding angle which is detected by the detection device.
 49. Aprojector device, comprising: a body portion that comprises a firstportion which has a construction to be rotated around a predeterminedrotation shaft as a center and a second portion which is linked to thefirst portion; a detection device that detects a rotational angle of thefirst portion with respect to a predetermined reference position; aprojection image generation device that projects an image upon aprojection surface and generates a projection image of the image, whoseprojection direction is fixed with respect to the first portion; and atrapezoidal compensation device that compensates trapezoidal deformationof the projection image created according to an angle between theprojection direction of the projection image generation device and theprojection surface, based upon the rotational angle which is detected bythe detection device.
 50. A projector device according to claim 48,wherein the trapezoidal compensation device repeatedly performs thecompensation of the trapezoidal deformation during the projection of theprojection image.
 51. A projector device according to claim 50, whereinthe trapezoidal compensation device repeatedly performs the compensationof the trapezoidal deformation upon a fixed cycle.
 52. A projectordevice according to claim 50, further comprising an actuation inputdevice for receiving actuation input from a user; and wherein thetrapezoidal compensation device repeatedly performs the compensation ofthe trapezoidal deformation each time actuation input is performed tothe actuation input device.
 53. A projector device according to claim50, further comprising a setting device that sets a frequency ofcompensation of the trapezoidal deformation; and wherein the trapezoidalcompensation device: when a first frequency of adjustment is set by thesetting device, performs compensation of the trapezoidal deformationrepeatedly during the projection of the projection image; when a secondfrequency of adjustment is set, performs compensation of the trapezoidaldeformation only once during the projection of the projection image; andwhen a third frequency of adjustment is set, does not performcompensation of the trapezoidal deformation.
 54. A portable telephone,comprising a projector device according claim 1 and a wirelesscommunication device that performs communication with another terminalvia an external wireless communication facility.
 55. A camera,comprising a projector device according to claim 1.